flume-是否可以阅读hornetq主题?

0ve6wy6x  于 2021-06-03  发布在  Hadoop
关注(0)|答案(0)|浏览(215)

我想使用flume从远程hornetq主题获取数据,并将数据放入hdfs中。
我有一个示例flume.conf文件,它似乎允许从远程activemq服务器读取:


# Name the components on this agent

a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source

a1.sources.r1.type = jms
a1.sources.r1.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.connectionFactory = GenericConnectionFactory
a1.sources.r1.providerURL = tcp://10.xxx.xxx.xx:7676
a1.sources.r1.destinationName = topic_name
a1.sources.r1.destinationType = TOPIC

# Describe the sink

a1.sinks.k1.type = hdfs
a1.sinks.k1.hdfs.path = hdfs://localhost:8020/data/flume/
a1.sinks.k1.hdfs.fileType = DataStream

# Use a channel which buffers events in memory

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel

a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

尤其是,配置文件的这一部分有问题:


# Describe/configure the source

a1.sources.r1.type = jms
a1.sources.r1.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.connectionFactory = GenericConnectionFactory
a1.sources.r1.providerURL = tcp://10.xxx.xxx.xx:7676
a1.sources.r1.destinationName = topic_name
a1.sources.r1.destinationType = TOPIC

我只在互联网上发现了一些hornetq接收器插件和一些hornetq频道插件。但是我没有找到源插件。
那么,有没有可能用Flume读取大黄蜂号的数据呢?如果是,怎么做?
非常感谢你。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题