我想使用flume从远程hornetq主题获取数据,并将数据放入hdfs中。
我有一个示例flume.conf文件,它似乎允许从远程activemq服务器读取:
# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1
# Describe/configure the source
a1.sources.r1.type = jms
a1.sources.r1.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.connectionFactory = GenericConnectionFactory
a1.sources.r1.providerURL = tcp://10.xxx.xxx.xx:7676
a1.sources.r1.destinationName = topic_name
a1.sources.r1.destinationType = TOPIC
# Describe the sink
a1.sinks.k1.type = hdfs
a1.sinks.k1.hdfs.path = hdfs://localhost:8020/data/flume/
a1.sinks.k1.hdfs.fileType = DataStream
# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100
# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1
尤其是,配置文件的这一部分有问题:
# Describe/configure the source
a1.sources.r1.type = jms
a1.sources.r1.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.connectionFactory = GenericConnectionFactory
a1.sources.r1.providerURL = tcp://10.xxx.xxx.xx:7676
a1.sources.r1.destinationName = topic_name
a1.sources.r1.destinationType = TOPIC
我只在互联网上发现了一些hornetq接收器插件和一些hornetq频道插件。但是我没有找到源插件。
那么,有没有可能用Flume读取大黄蜂号的数据呢?如果是,怎么做?
非常感谢你。
暂无答案!
目前还没有任何答案,快来回答吧!