CanFlume1.5处理/传输压缩文件到hdfs接收器

8ljdwjyq  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(258)

Flume1.5可以处理/传输压缩文件到hdfs接收器。我试着用blobdeseserializer和压缩流和编解码器作为gzip。我使用的配置选项如下

agent1.sources.c1.deserializer =org.apache.flume.sink.solr.morphline.BlobDeserializer$Builder
agent1.sinks.c1s1.hdfs.fileType = CompressedStream
agent1.sinks.c1s1.hdfs.writeFormat = Text
agent1.sinks.c1s1.hdfs.filePrefix = %{file}
agent1.sinks.c1s1.hdfs.codeC = gzip
agent1.sinks.c1s1.hdfs.serializer.compressionCodec = gzip

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题