Netty学习

文章10 |   阅读 5318 |   点赞0

来源：https://blog.csdn.net/a953713428/category_6806288.html

Netty学习(十)-Netty文件上传

转x33g5p2x  于2021-12-21 转载在 其他  
字(22.3k)|赞(0)|评价(0)|浏览(1029)

今天我们来完成一个使用netty进行文件传输的任务。在实际项目中，文件传输通常采用FTP或者HTTP附件的方式。事实上通过TCP Socket+File的方式进行文件传输也有一定的应用场景，尽管不是主流，但是掌握这种文件传输方式还是比较重要的，特别是针对两个跨主机的JVM进程之间进行持久化数据的相互交换。

而使用netty来进行文件传输也是利用netty天然的优势：零拷贝功能。很多同学都听说过netty的”零拷贝”功能，但是具体体现在哪里又不知道，下面我们就简要介绍下：

Netty的“零拷贝”主要体现在如下三个方面：

  1. Netty的接收和发送ByteBuffer采用DIRECT BUFFERS，使用堆外直接内存进行Socket读写，不需要进行字节缓冲区的二次拷贝。如果使用传统的堆内存（HEAP BUFFERS）进行Socket读写，JVM会将堆内存Buffer拷贝一份到直接内存中，然后才写入Socket中。相比于堆外直接内存，消息在发送过程中多了一次缓冲区的内存拷贝。

  2. Netty提供了组合Buffer对象，可以聚合多个ByteBuffer对象，用户可以像操作一个Buffer那样方便的对组合Buffer进行操作，避免了传统通过内存拷贝的方式将几个小Buffer合并成一个大的Buffer。

  3. Netty的文件传输采用了transferTo方法，它可以直接将文件缓冲区的数据发送到目标Channel，避免了传统通过循环write方式导致的内存拷贝问题。

具体的分析在此就不多做介绍，有兴趣的可以查阅相关文档。我们还是把重点放在文件传输上。Netty作为高性能的服务器端异步IO框架必然也离不开文件读写功能，我们可以使用netty模拟http的形式通过网页上传文件写入服务器，当然要使用http的形式那你也用不着netty！大材小用。netty4中如果想使用http形式上传文件你还得借助第三方jar包：okhttp。使用该jar完成http请求的发送。但是在netty5 中已经为我们写好了，我们可以直接调用netty5的API就可以实现。所以netty4和5的差别还是挺大的，至于使用哪个，那就看你们公司选择哪一个了！本文目前使用netty4来实现文件上传功能。下面我们上代码：

pom文件：

  1. <dependency>
  2.       <groupId>io.netty</groupId>
  3.         <artifactId>netty-all</artifactId>
  4.       <version>4.1.5.Final</version>
  5. </dependency>

server端：

  1. import io.netty.bootstrap.ServerBootstrap;
  2. import io.netty.channel.Channel;
  3. import io.netty.channel.ChannelFuture;
  4. import io.netty.channel.ChannelInitializer;
  5. import io.netty.channel.ChannelOption;
  6. import io.netty.channel.EventLoopGroup;
  7. import io.netty.channel.nio.NioEventLoopGroup;
  8. import io.netty.channel.socket.nio.NioServerSocketChannel;
  9. import io.netty.handler.codec.serialization.ClassResolvers;
  10. import io.netty.handler.codec.serialization.ObjectDecoder;
  11. import io.netty.handler.codec.serialization.ObjectEncoder;
  13. public class FileUploadServer {
  14.     public void bind(int port) throws Exception {
  15.         EventLoopGroup bossGroup = new NioEventLoopGroup();
  16.         EventLoopGroup workerGroup = new NioEventLoopGroup();
  17.         try {
  18.             ServerBootstrap b = new ServerBootstrap();
  19.             b.group(bossGroup, workerGroup).channel(NioServerSocketChannel.class).option(ChannelOption.SO_BACKLOG, 1024).childHandler(new ChannelInitializer<Channel>() {
  21.                 @Override
  22.                 protected void initChannel(Channel ch) throws Exception {
  23.                     ch.pipeline().addLast(new ObjectEncoder());
  24.                     ch.pipeline().addLast(new ObjectDecoder(Integer.MAX_VALUE, ClassResolvers.weakCachingConcurrentResolver(null))); // 最大长度
  25.                     ch.pipeline().addLast(new FileUploadServerHandler());
  26.                 }
  27.             });
  28.             ChannelFuture f = b.bind(port).sync();
  29.             f.channel().closeFuture().sync();
  30.         } finally {
  31.             bossGroup.shutdownGracefully();
  32.             workerGroup.shutdownGracefully();
  33.         }
  34.     }
  36.     public static void main(String[] args) {
  37.         int port = 8080;
  38.         if (args != null && args.length > 0) {
  39.             try {
  40.                 port = Integer.valueOf(args[0]);
  41.             } catch (NumberFormatException e) {
  42.                 e.printStackTrace();
  43.             }
  44.         }
  45.         try {
  46.             new FileUploadServer().bind(port);
  47.         } catch (Exception e) {
  48.             e.printStackTrace();
  49.         }
  50.     }
  51. }

server端handler：

  1. import io.netty.channel.ChannelHandlerContext;
  2. import io.netty.channel.ChannelInboundHandlerAdapter;
  4. import java.io.File;
  5. import java.io.RandomAccessFile;
  7. public class FileUploadServerHandler extends ChannelInboundHandlerAdapter {
  8.     private int byteRead;
  9.     private volatile int start = 0;
  10.     private String file_dir = "D:";
  12.     @Override
  13.     public void channelRead(ChannelHandlerContext ctx, Object msg) throws Exception {
  14.         if (msg instanceof FileUploadFile) {
  15.             FileUploadFile ef = (FileUploadFile) msg;
  16.             byte[] bytes = ef.getBytes();
  17.             byteRead = ef.getEndPos();
  18.             String md5 = ef.getFile_md5();//文件名
  19.             String path = file_dir + File.separator + md5;
  20.             File file = new File(path);
  21.             RandomAccessFile randomAccessFile = new RandomAccessFile(file, "rw");
  22.             randomAccessFile.seek(start);
  23.             randomAccessFile.write(bytes);
  24.             start = start + byteRead;
  25.             if (byteRead > 0) {
  26.                 ctx.writeAndFlush(start);
  27.             } else {
  28.                 randomAccessFile.close();
  29.                 ctx.close();
  30.             }
  31.         }
  32.     }
  34.     @Override
  35.     public void exceptionCaught(ChannelHandlerContext ctx, Throwable cause) {
  36.         cause.printStackTrace();
  37.         ctx.close();
  38.     }
  39. }

client端：

  1. import io.netty.bootstrap.Bootstrap;
  2. import io.netty.channel.Channel;
  3. import io.netty.channel.ChannelFuture;
  4. import io.netty.channel.ChannelInitializer;
  5. import io.netty.channel.ChannelOption;
  6. import io.netty.channel.EventLoopGroup;
  7. import io.netty.channel.nio.NioEventLoopGroup;
  8. import io.netty.channel.socket.nio.NioSocketChannel;
  9. import io.netty.handler.codec.serialization.ClassResolvers;
  10. import io.netty.handler.codec.serialization.ObjectDecoder;
  11. import io.netty.handler.codec.serialization.ObjectEncoder;
  12. import java.io.File;
  14. public class FileUploadClient {
  15.     public void connect(int port, String host, final FileUploadFile fileUploadFile) throws Exception {
  16.         EventLoopGroup group = new NioEventLoopGroup();
  17.         try {
  18.             Bootstrap b = new Bootstrap();
  19.             b.group(group).channel(NioSocketChannel.class).option(ChannelOption.TCP_NODELAY, true).handler(new ChannelInitializer<Channel>() {
  21.                 @Override
  22.                 protected void initChannel(Channel ch) throws Exception {
  23.                     ch.pipeline().addLast(new ObjectEncoder());
  24.                     ch.pipeline().addLast(new ObjectDecoder(ClassResolvers.weakCachingConcurrentResolver(null)));
  25.                     ch.pipeline().addLast(new FileUploadClientHandler(fileUploadFile));
  26.                 }
  27.             });
  28.             ChannelFuture f = b.connect(host, port).sync();
  29.             f.channel().closeFuture().sync();
  30.         } finally {
  31.             group.shutdownGracefully();
  32.         }
  33.     }
  35.     public static void main(String[] args) {
  36.         int port = 8080;
  37.         if (args != null && args.length > 0) {
  38.             try {
  39.                 port = Integer.valueOf(args[0]);
  40.             } catch (NumberFormatException e) {
  41.                 e.printStackTrace();
  42.             }
  43.         }
  44.         try {
  45.             FileUploadFile uploadFile = new FileUploadFile();
  46.             File file = new File("c:/1.txt");
  47.             String fileMd5 = file.getName();// 文件名
  48.             uploadFile.setFile(file);
  49.             uploadFile.setFile_md5(fileMd5);
  50.             uploadFile.setStarPos(0);// 文件开始位置
  51.             new FileUploadClient().connect(port, "127.0.0.1", uploadFile);
  52.         } catch (Exception e) {
  53.             e.printStackTrace();
  54.         }
  55.     }
  56. }

client端handler：

  1. import io.netty.channel.ChannelHandlerContext;
  2. import io.netty.channel.ChannelInboundHandlerAdapter;
  4. import java.io.FileNotFoundException;
  5. import java.io.IOException;
  6. import java.io.RandomAccessFile;
  8. public class FileUploadClientHandler extends ChannelInboundHandlerAdapter {
  9.     private int byteRead;
  10.     private volatile int start = 0;
  11.     private volatile int lastLength = 0;
  12.     public RandomAccessFile randomAccessFile;
  13.     private FileUploadFile fileUploadFile;
  15.     public FileUploadClientHandler(FileUploadFile ef) {
  16.         if (ef.getFile().exists()) {
  17.             if (!ef.getFile().isFile()) {
  18.                 System.out.println("Not a file :" + ef.getFile());
  19.                 return;
  20.             }
  21.         }
  22.         this.fileUploadFile = ef;
  23.     }
  25.     public void channelActive(ChannelHandlerContext ctx) {
  26.         try {
  27.             randomAccessFile = new RandomAccessFile(fileUploadFile.getFile(), "r");
  28.             randomAccessFile.seek(fileUploadFile.getStarPos());
  29.             lastLength = (int) randomAccessFile.length() / 10;
  30.             byte[] bytes = new byte[lastLength];
  31.             if ((byteRead = randomAccessFile.read(bytes)) != -1) {
  32.                 fileUploadFile.setEndPos(byteRead);
  33.                 fileUploadFile.setBytes(bytes);
  34.                 ctx.writeAndFlush(fileUploadFile);
  35.             } else {
  36.                 System.out.println("文件已经读完");
  37.             }
  38.         } catch (FileNotFoundException e) {
  39.             e.printStackTrace();
  40.         } catch (IOException i) {
  41.             i.printStackTrace();
  42.         }
  43.     }
  45.     @Override
  46.     public void channelRead(ChannelHandlerContext ctx, Object msg) throws Exception {
  47.         if (msg instanceof Integer) {
  48.             start = (Integer) msg;
  49.             if (start != -1) {
  50.                 randomAccessFile = new RandomAccessFile(fileUploadFile.getFile(), "r");
  51.                 randomAccessFile.seek(start);
  52.                 System.out.println("块儿长度：" + (randomAccessFile.length() / 10));
  53.                 System.out.println("长度：" + (randomAccessFile.length() - start));
  54.                 int a = (int) (randomAccessFile.length() - start);
  55.                 int b = (int) (randomAccessFile.length() / 10);
  56.                 if (a < b) {
  57.                     lastLength = a;
  58.                 }
  59.                 byte[] bytes = new byte[lastLength];
  60.                 System.out.println("-----------------------------" + bytes.length);
  61.                 if ((byteRead = randomAccessFile.read(bytes)) != -1 && (randomAccessFile.length() - start) > 0) {
  62.                     System.out.println("byte 长度：" + bytes.length);
  63.                     fileUploadFile.setEndPos(byteRead);
  64.                     fileUploadFile.setBytes(bytes);
  65.                     try {
  66.                         ctx.writeAndFlush(fileUploadFile);
  67.                     } catch (Exception e) {
  68.                         e.printStackTrace();
  69.                     }
  70.                 } else {
  71.                     randomAccessFile.close();
  72.                     ctx.close();
  73.                     System.out.println("文件已经读完--------" + byteRead);
  74.                 }
  75.             }
  76.         }
  77.     }
  79.     // @Override
  80.     // public void channelRead(ChannelHandlerContext ctx, Object msg) throws
  81.     // Exception {
  82.     // System.out.println("Server is speek ："+msg.toString());
  83.     // FileRegion filer = (FileRegion) msg;
  84.     // String path = "E://Apk//APKMD5.txt";
  85.     // File fl = new File(path);
  86.     // fl.createNewFile();
  87.     // RandomAccessFile rdafile = new RandomAccessFile(path, "rw");
  88.     // FileRegion f = new DefaultFileRegion(rdafile.getChannel(), 0,
  89.     // rdafile.length());
  90.     //
  91.     // System.out.println("This is" + ++counter + "times receive server:["
  92.     // + msg + "]");
  93.     // }
  95.     // @Override
  96.     // public void channelReadComplete(ChannelHandlerContext ctx) throws
  97.     // Exception {
  98.     // ctx.flush();
  99.     // }
  101.     public void exceptionCaught(ChannelHandlerContext ctx, Throwable cause) {
  102.         cause.printStackTrace();
  103.         ctx.close();
  104.     }
  105.     // @Override
  106.     // protected void channelRead0(ChannelHandlerContext ctx, String msg)
  107.     // throws Exception {
  108.     // String a = msg;
  109.     // System.out.println("This is"+
  110.     // ++counter+"times receive server:["+msg+"]");
  111.     // }
  112. }

我们还自定义了一个对象，用于统计文件上传进度的：

  1. import java.io.File;
  2. import java.io.Serializable;
  4. public class FileUploadFile implements Serializable {
  6.     private static final long serialVersionUID = 1L;
  7.     private File file;// 文件
  8.     private String file_md5;// 文件名
  9.     private int starPos;// 开始位置
  10.     private byte[] bytes;// 文件字节数组
  11.     private int endPos;// 结尾位置
  13.     public int getStarPos() {
  14.         return starPos;
  15.     }
  17.     public void setStarPos(int starPos) {
  18.         this.starPos = starPos;
  19.     }
  21.     public int getEndPos() {
  22.         return endPos;
  23.     }
  25.     public void setEndPos(int endPos) {
  26.         this.endPos = endPos;
  27.     }
  29.     public byte[] getBytes() {
  30.         return bytes;
  31.     }
  33.     public void setBytes(byte[] bytes) {
  34.         this.bytes = bytes;
  35.     }
  37.     public File getFile() {
  38.         return file;
  39.     }
  41.     public void setFile(File file) {
  42.         this.file = file;
  43.     }
  45.     public String getFile_md5() {
  46.         return file_md5;
  47.     }
  49.     public void setFile_md5(String file_md5) {
  50.         this.file_md5 = file_md5;
  51.     }
  52. }

输出为：

  1. 块儿长度：894
  2.     长度：8052
  3.     -----------------------------894
  4.     byte 长度：894
  5.     块儿长度：894
  6.     长度：7158
  7.     -----------------------------894
  8.     byte 长度：894
  9.     块儿长度：894
  10.     长度：6264
  11.     -----------------------------894
  12.     byte 长度：894
  13.     块儿长度：894
  14.     长度：5370
  15.     -----------------------------894
  16.     byte 长度：894
  17.     块儿长度：894
  18.     长度：4476
  19.     -----------------------------894
  20.     byte 长度：894
  21.     块儿长度：894
  22.     长度：3582
  23.     -----------------------------894
  24.     byte 长度：894
  25.     块儿长度：894
  26.     长度：2688
  27.     -----------------------------894
  28.     byte 长度：894
  29.     块儿长度：894
  30.     长度：1794
  31.     -----------------------------894
  32.     byte 长度：894
  33.     块儿长度：894
  34.     长度：900
  35.     -----------------------------894
  36.     byte 长度：894
  37.     块儿长度：894
  38.     长度：6
  39.     -----------------------------6
  40.     byte 长度：6
  41.     块儿长度：894
  42.     长度：0
  43.     -----------------------------0
  44.     文件已经读完--------0
  46.     Process finished with exit code 0

这样就实现了服务器端文件的上传，当然我们也可以使用http的形式。

server端：

  1. import io.netty.bootstrap.ServerBootstrap;
  2. import io.netty.channel.ChannelFuture;
  3. import io.netty.channel.EventLoopGroup;
  4. import io.netty.channel.nio.NioEventLoopGroup;
  5. import io.netty.channel.socket.nio.NioServerSocketChannel;
  7. public class HttpFileServer implements Runnable {
  8.     private int port;
  10.     public HttpFileServer(int port) {
  11.         super();
  12.         this.port = port;
  13.     }
  15.     @Override
  16.     public void run() {
  17.         EventLoopGroup bossGroup = new NioEventLoopGroup(1);
  18.         EventLoopGroup workerGroup = new NioEventLoopGroup();
  19.         ServerBootstrap serverBootstrap = new ServerBootstrap();
  20.         serverBootstrap.group(bossGroup, workerGroup);
  21.         serverBootstrap.channel(NioServerSocketChannel.class);
  22.         //serverBootstrap.handler(new LoggingHandler(LogLevel.INFO));
  23.         serverBootstrap.childHandler(new HttpChannelInitlalizer());
  24.         try {
  25.             ChannelFuture f = serverBootstrap.bind(port).sync();
  26.             f.channel().closeFuture().sync();
  27.         } catch (InterruptedException e) {
  28.             e.printStackTrace();
  29.         } finally {
  30.             bossGroup.shutdownGracefully();
  31.             workerGroup.shutdownGracefully();
  32.         }
  33.     }
  35.     public static void main(String[] args) {
  36.         HttpFileServer b = new HttpFileServer(9003);
  37.         new Thread(b).start();
  38.     }
  39. }

Server端initializer：

  1. import io.netty.channel.ChannelInitializer;
  2. import io.netty.channel.ChannelPipeline;
  3. import io.netty.channel.socket.SocketChannel;
  4. import io.netty.handler.codec.http.HttpObjectAggregator;
  5. import io.netty.handler.codec.http.HttpServerCodec;
  6. import io.netty.handler.stream.ChunkedWriteHandler;
  8. public class HttpChannelInitlalizer extends ChannelInitializer<SocketChannel> {
  10.     @Override
  11.     protected void initChannel(SocketChannel ch) throws Exception {
  12.         ChannelPipeline pipeline = ch.pipeline();
  13.         pipeline.addLast(new HttpServerCodec());
  14.         pipeline.addLast(new HttpObjectAggregator(65536));
  15.         pipeline.addLast(new ChunkedWriteHandler());
  16.         pipeline.addLast(new HttpChannelHandler());
  17.     }
  19. }

server端hadler：

  1. import static io.netty.handler.codec.http.HttpHeaders.Names.CONTENT_TYPE;
  2. import static io.netty.handler.codec.http.HttpResponseStatus.BAD_REQUEST;
  3. import static io.netty.handler.codec.http.HttpResponseStatus.FORBIDDEN;
  4. import static io.netty.handler.codec.http.HttpResponseStatus.INTERNAL_SERVER_ERROR;
  5. import static io.netty.handler.codec.http.HttpResponseStatus.NOT_FOUND;
  6. import static io.netty.handler.codec.http.HttpVersion.HTTP_1_1;
  7. import io.netty.buffer.Unpooled;
  8. import io.netty.channel.ChannelFuture;
  9. import io.netty.channel.ChannelFutureListener;
  10. import io.netty.channel.ChannelHandlerContext;
  11. import io.netty.channel.ChannelProgressiveFuture;
  12. import io.netty.channel.ChannelProgressiveFutureListener;
  13. import io.netty.channel.SimpleChannelInboundHandler;
  14. import io.netty.handler.codec.http.DefaultFullHttpResponse;
  15. import io.netty.handler.codec.http.DefaultHttpResponse;
  16. import io.netty.handler.codec.http.FullHttpRequest;
  17. import io.netty.handler.codec.http.FullHttpResponse;
  18. import io.netty.handler.codec.http.HttpChunkedInput;
  19. import io.netty.handler.codec.http.HttpHeaders;
  20. import io.netty.handler.codec.http.HttpResponse;
  21. import io.netty.handler.codec.http.HttpResponseStatus;
  22. import io.netty.handler.codec.http.HttpVersion;
  23. import io.netty.handler.codec.http.LastHttpContent;
  24. import io.netty.handler.stream.ChunkedFile;
  25. import io.netty.util.CharsetUtil;
  26. import io.netty.util.internal.SystemPropertyUtil;
  28. import java.io.File;
  29. import java.io.FileNotFoundException;
  30. import java.io.RandomAccessFile;
  31. import java.io.UnsupportedEncodingException;
  32. import java.net.URLDecoder;
  33. import java.util.regex.Pattern;
  35. import javax.activation.MimetypesFileTypeMap;
  37. public class HttpChannelHandler extends SimpleChannelInboundHandler<FullHttpRequest> {
  38.     public static final String HTTP_DATE_FORMAT = "EEE, dd MMM yyyy HH:mm:ss zzz";
  39.     public static final String HTTP_DATE_GMT_TIMEZONE = "GMT";
  40.     public static final int HTTP_CACHE_SECONDS = 60;
  42.     @Override
  43.     protected void channelRead0(ChannelHandlerContext ctx, FullHttpRequest request) throws Exception {
  44.         // 监测解码情况
  45.         if (!request.getDecoderResult().isSuccess()) {
  46.             sendError(ctx, BAD_REQUEST);
  47.             return;
  48.         }
  49.         final String uri = request.getUri();
  50.         final String path = sanitizeUri(uri);
  51.         System.out.println("get file："+path);
  52.         if (path == null) {
  53.             sendError(ctx, FORBIDDEN);
  54.             return;
  55.         }
  56.         //读取要下载的文件
  57.         File file = new File(path);
  58.         if (file.isHidden() || !file.exists()) {
  59.             sendError(ctx, NOT_FOUND);
  60.             return;
  61.         }
  62.         if (!file.isFile()) {
  63.             sendError(ctx, FORBIDDEN);
  64.             return;
  65.         }
  66.         RandomAccessFile raf;
  67.         try {
  68.             raf = new RandomAccessFile(file, "r");
  69.         } catch (FileNotFoundException ignore) {
  70.             sendError(ctx, NOT_FOUND);
  71.             return;
  72.         }
  73.         long fileLength = raf.length();
  74.         HttpResponse response = new DefaultHttpResponse(HttpVersion.HTTP_1_1, HttpResponseStatus.OK);
  75.         HttpHeaders.setContentLength(response, fileLength);
  76.         setContentTypeHeader(response, file);
  77.         //setDateAndCacheHeaders(response, file);
  78.         if (HttpHeaders.isKeepAlive(request)) {
  79.             response.headers().set("CONNECTION", HttpHeaders.Values.KEEP_ALIVE);
  80.         }
  82.         // Write the initial line and the header.
  83.         ctx.write(response);
  85.         // Write the content.
  86.         ChannelFuture sendFileFuture =
  87.         ctx.write(new HttpChunkedInput(new ChunkedFile(raf, 0, fileLength, 8192)), ctx.newProgressivePromise());
  88.         //sendFuture用于监视发送数据的状态
  89.         sendFileFuture.addListener(new ChannelProgressiveFutureListener() {
  90.             @Override
  91.             public void operationProgressed(ChannelProgressiveFuture future, long progress, long total) {
  92.                 if (total < 0) { // total unknown
  93.                     System.err.println(future.channel() + " Transfer progress: " + progress);
  94.                 } else {
  95.                     System.err.println(future.channel() + " Transfer progress: " + progress + " / " + total);
  96.                 }
  97.             }
  99.             @Override
  100.             public void operationComplete(ChannelProgressiveFuture future) {
  101.                 System.err.println(future.channel() + " Transfer complete.");
  102.             }
  103.         });
  105.         // Write the end marker
  106.         ChannelFuture lastContentFuture = ctx.writeAndFlush(LastHttpContent.EMPTY_LAST_CONTENT);
  108.         // Decide whether to close the connection or not.
  109.         if (!HttpHeaders.isKeepAlive(request)) {
  110.             // Close the connection when the whole content is written out.
  111.             lastContentFuture.addListener(ChannelFutureListener.CLOSE);
  112.         }
  113.     }
  115.     @Override
  116.     public void exceptionCaught(ChannelHandlerContext ctx, Throwable cause) {
  117.         cause.printStackTrace();
  118.         if (ctx.channel().isActive()) {
  119.             sendError(ctx, INTERNAL_SERVER_ERROR);
  120.         }
  121.         ctx.close();
  122.     }
  124.     private static final Pattern INSECURE_URI = Pattern.compile(".*[<>&\"].*");
  126.     private static String sanitizeUri(String uri) {
  127.         // Decode the path.
  128.         try {
  129.             uri = URLDecoder.decode(uri, "UTF-8");
  130.         } catch (UnsupportedEncodingException e) {
  131.             throw new Error(e);
  132.         }
  134.         if (!uri.startsWith("/")) {
  135.             return null;
  136.         }
  138.         // Convert file separators.
  139.         uri = uri.replace('/', File.separatorChar);
  141.         // Simplistic dumb security check.
  142.         // You will have to do something serious in the production environment.
  143.         if (uri.contains(File.separator + '.') || uri.contains('.' + File.separator) || uri.startsWith(".") || uri.endsWith(".")
  144.                 || INSECURE_URI.matcher(uri).matches()) {
  145.             return null;
  146.         }
  148.         // Convert to absolute path.
  149.         return SystemPropertyUtil.get("user.dir") + File.separator + uri;
  150.     }
  152.     private static void sendError(ChannelHandlerContext ctx, HttpResponseStatus status) {
  153.         FullHttpResponse response = new DefaultFullHttpResponse(HTTP_1_1, status, Unpooled.copiedBuffer("Failure: " + status + "\r\n", CharsetUtil.UTF_8));
  154.         response.headers().set(CONTENT_TYPE, "text/plain; charset=UTF-8");
  156.         // Close the connection as soon as the error message is sent.
  157.         ctx.writeAndFlush(response).addListener(ChannelFutureListener.CLOSE);
  158.     }
  160.     /** * Sets the content type header for the HTTP Response * * @param response * HTTP response * @param file * file to extract content type */
  161.     private static void setContentTypeHeader(HttpResponse response, File file) {
  162.         MimetypesFileTypeMap m = new MimetypesFileTypeMap();
  163.         String contentType = m.getContentType(file.getPath());
  164.         if (!contentType.equals("application/octet-stream")) {
  165.             contentType += "; charset=utf-8";
  166.         }
  167.         response.headers().set(CONTENT_TYPE, contentType);
  168.     }
  170. }

client端：

  1. import io.netty.bootstrap.Bootstrap;
  2. import io.netty.channel.ChannelFuture;
  3. import io.netty.channel.ChannelInitializer;
  4. import io.netty.channel.ChannelOption;
  5. import io.netty.channel.EventLoopGroup;
  6. import io.netty.channel.nio.NioEventLoopGroup;
  7. import io.netty.channel.socket.SocketChannel;
  8. import io.netty.channel.socket.nio.NioSocketChannel;
  9. import io.netty.handler.codec.http.DefaultFullHttpRequest;
  10. import io.netty.handler.codec.http.HttpHeaders;
  11. import io.netty.handler.codec.http.HttpMethod;
  12. import io.netty.handler.codec.http.HttpRequestEncoder;
  13. import io.netty.handler.codec.http.HttpResponseDecoder;
  14. import io.netty.handler.codec.http.HttpVersion;
  15. import io.netty.handler.stream.ChunkedWriteHandler;
  17. import java.net.URI;
  19. public class HttpDownloadClient {
  20.     /** * 下载http资源 向服务器下载直接填写要下载的文件的相对路径 * （↑↑↑建议只使用字母和数字对特殊字符对字符进行部分过滤可能导致异常↑↑↑） * 向互联网下载输入完整路径 * @param host 目的主机ip或域名 * @param port 目标主机端口 * @param url 文件路径 * @param local 本地存储路径 * @throws Exception */
  21.     public void connect(String host, int port, String url, final String local) throws Exception {
  22.         EventLoopGroup workerGroup = new NioEventLoopGroup();
  23.         try {
  24.             Bootstrap b = new Bootstrap();
  25.             b.group(workerGroup);
  26.             b.channel(NioSocketChannel.class);
  27.             b.option(ChannelOption.SO_KEEPALIVE, true);
  28.             b.handler(new ChildChannelHandler(local));
  30.             // Start the client.
  31.             ChannelFuture f = b.connect(host, port).sync();
  33.             URI uri = new URI(url);
  34.             DefaultFullHttpRequest request = new DefaultFullHttpRequest(
  35.                     HttpVersion.HTTP_1_1, HttpMethod.GET, uri.toASCIIString());
  37.             // 构建http请求
  38.             request.headers().set(HttpHeaders.Names.HOST, host);
  39.             request.headers().set(HttpHeaders.Names.CONNECTION,
  40.                     HttpHeaders.Values.KEEP_ALIVE);
  41.             request.headers().set(HttpHeaders.Names.CONTENT_LENGTH,
  42.                     request.content().readableBytes());
  43.             // 发送http请求
  44.             f.channel().write(request);
  45.             f.channel().flush();
  46.             f.channel().closeFuture().sync();
  47.         } finally {
  48.             workerGroup.shutdownGracefully();
  49.         }
  51.     }
  53.     private class ChildChannelHandler extends ChannelInitializer<SocketChannel> {
  54.         String local;
  55.         public ChildChannelHandler(String local) {
  56.             this.local = local;
  57.         }
  59.         @Override
  60.         protected void initChannel(SocketChannel ch) throws Exception {
  61.             // 客户端接收到的是httpResponse响应，所以要使用HttpResponseDecoder进行解码
  62.             ch.pipeline().addLast(new HttpResponseDecoder());
  63.             // 客户端发送的是httprequest，所以要使用HttpRequestEncoder进行编码
  64.             ch.pipeline().addLast(new HttpRequestEncoder());
  65.             ch.pipeline().addLast(new ChunkedWriteHandler());
  66.             ch.pipeline().addLast(new HttpDownloadHandler(local));
  67.         }
  69.     }
  70.     public static void main(String[] args) throws Exception {
  71.         HttpDownloadClient client = new HttpDownloadClient();
  72.         //client.connect("127.0.0.1", 9003,"/file/pppp/1.doc","1.doc");
  73. //        client.connect("zlysix.gree.com", 80, "http://zlysix.gree.com/HelloWeb/download/20m.apk", "20m.apk");
  74.         client.connect("www.ghost64.com", 80, "http://www.ghost64.com/qqtupian/zixunImg/local/2017/05/27/1495855297602.jpg", "1495855297602.jpg");
  76.     }
  77. }

client端handler：

  1. import java.io.File;
  2. import java.io.FileOutputStream;
  4. import io.netty.buffer.ByteBuf;
  5. import io.netty.channel.ChannelHandlerContext;
  6. import io.netty.channel.ChannelInboundHandlerAdapter;
  7. import io.netty.handler.codec.http.HttpContent;
  8. //import io.netty.handler.codec.http.HttpHeaders;
  9. import io.netty.handler.codec.http.HttpResponse;
  10. import io.netty.handler.codec.http.LastHttpContent;
  11. import io.netty.util.internal.SystemPropertyUtil;
  12. /** * @Author:yangyue * @Description: * @Date: Created in 9:15 on 2017/5/28. */
  14. public class HttpDownloadHandler extends ChannelInboundHandlerAdapter {
  15.     private boolean readingChunks = false; // 分块读取开关
  16.     private FileOutputStream fOutputStream = null;// 文件输出流
  17.     private File localfile = null;// 下载文件的本地对象
  18.     private String local = null;// 待下载文件名
  19.     private int succCode;// 状态码
  21.     public HttpDownloadHandler(String local) {
  22.         this.local = local;
  23.     }
  25.     @Override
  26.     public void channelRead(ChannelHandlerContext ctx, Object msg)
  27.             throws Exception {
  28.         if (msg instanceof HttpResponse) {// response头信息
  29.             HttpResponse response = (HttpResponse) msg;
  30.             succCode = response.getStatus().code();
  31.             if (succCode == 200) {
  32.                 setDownLoadFile();// 设置下载文件
  33.                 readingChunks = true;
  34.             }
  35.             // System.out.println("CONTENT_TYPE:"
  36.             // + response.headers().get(HttpHeaders.Names.CONTENT_TYPE));
  37.         }
  38.         if (msg instanceof HttpContent) {// response体信息
  39.             HttpContent chunk = (HttpContent) msg;
  40.             if (chunk instanceof LastHttpContent) {
  41.                 readingChunks = false;
  42.             }
  44.             ByteBuf buffer = chunk.content();
  45.             byte[] dst = new byte[buffer.readableBytes()];
  46.             if (succCode == 200) {
  47.                 while (buffer.isReadable()) {
  48.                     buffer.readBytes(dst);
  49.                     fOutputStream.write(dst);
  50.                     buffer.release();
  51.                 }
  52.                 if (null != fOutputStream) {
  53.                     fOutputStream.flush();
  54.                 }
  55.             }
  57.         }
  58.         if (!readingChunks) {
  59.             if (null != fOutputStream) {
  60.                 System.out.println("Download done->"+ localfile.getAbsolutePath());
  61.                 fOutputStream.flush();
  62.                 fOutputStream.close();
  63.                 localfile = null;
  64.                 fOutputStream = null;
  65.             }
  66.             ctx.channel().close();
  67.         }
  68.     }
  70.     /** * 配置本地参数，准备下载 */
  71.     private void setDownLoadFile() throws Exception {
  72.         if (null == fOutputStream) {
  73.             local = SystemPropertyUtil.get("user.dir") + File.separator +local;
  74.             //System.out.println(local);
  75.             localfile = new File(local);
  76.             if (!localfile.exists()) {
  77.                 localfile.createNewFile();
  78.             }
  79.             fOutputStream = new FileOutputStream(localfile);
  80.         }
  81.     }
  83.     @Override
  84.     public void exceptionCaught(ChannelHandlerContext ctx, Throwable cause)
  85.             throws Exception {
  86.         System.out.println("管道异常：" + cause.getMessage());
  87.         cause.printStackTrace();
  88.         ctx.channel().close();
  89.     }
  90. }

这里客户端我放的是网络连接，下载的是一副图片，启动服务端和客户端就可以看到这个图片被下载到了工程的根目录下。

版权说明 : 本文为转载文章, 版权归原作者所有 版权申明

原文链接 : https://blog.csdn.net/a953713428/article/details/72792909

内容来源于网络，如有侵权，请联系作者删除！

nettynetty学习netty教程

相关文章

    查看更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com