我在aws示例上运行flume代理,无法从aws示例上的avro接收器接收事件到本地计算机上的avro源?

nafvub8i  于 2021-06-04  发布在  Flume
关注(0)|答案(1)|浏览(478)

这是在我的aws示例的控制台上出现的错误。
2014-08-09 12:22:41803(lifecyclesupervisor-1-2)[info-org.apache.flume.source.avrosource.start(avrosource)。java:142)]正在从本地启动avro源:{bindaddress:ec2-54-221-143-114.compute-1.amazonaws.com,端口:44444}。。。2014-08-09 12:22:42072(lifecyclesupervisor-1-1)[警告-org.apache.flume.sink.avrosink.start(avrosink。java:244)]无法使用主机名:ec2-54-221-143-114.compute-1.amazonaws.com,端口:41414 org.apache.flume.flumeexception:nettyavrorcclient{主机名:ec2-54-221-143-114.compute-1.amazonaws.com,端口:41414}:org.apache.flume.api.nettyavorpclient.connect(nettyavorpclient)的rpc连接错误。java:117)在org.apache.flume.api.nettyavorpclient.connect(nettyavorpclient。java:93)在org.apache.flume.api.nettyavorpclient.configure(nettyavorpclient。java:514)在org.apache.flume.api.rpcclientfactory.getinstance(rpcclientfactory)。java:88)在org.apache.flume.sink.avrosink.createconnection(avrosink。java:182)在org.apache.flume.sink.avrosink.start(avrosink。java:242)在org.apache.flume.sink.defaultsinkprocessor.start(defaultsinkprocessor。java:46)在org.apache.flume.sinkrunner.start(sinkrunner。java:79)在org.apache.flume.lifecyclesupervisor$monitorUnnable.run(生命周期监督器。java:236)在java.util.concurrent.executors$runnableadapter.call(executors。java:471)在java.util.concurrent.futuretask.runandreset(futuretask。java:304)在java.util.concurrent.scheduledthreadpoolexecutor$scheduledfuturetask.access$301(scheduledthreadpoolexecutor。java:178)在java.util.concurrent.scheduledthreadpoolexecutor$scheduledfuturetask.run(scheduledthreadpoolexecutor。java:293)位于java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor。java:1145)在java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor。java:615)在java.lang.thread.run(线程。java:744)原因:java.io.ioexception:连接到ec2-54-221-143-114.compute-1.amazonaws.com/10.80.54.114:41414的org.apache.avro.ipc.nettytransceiver.getchannel(nettytransceiver)时出错。java:261)在org.apache.avro.ipc.nettytransceiver.(nettytransceiver。java:203)在org.apache.avro.ipc.nettytransceiver。java:152)在org.apache.flume.api.nettyavorpclient.connect(nettyavorpclient。java:106) ... 另有15个原因:java.net.connectexception:sun.nio.ch.socketchannelimpl.checkconnect(本机方法)上的连接被拒绝,sun.nio.ch.socketchannelimpl.finishconnect(socketchannelimpl)。java:739)位于org.jboss.netty.channel.socket.nio.nioclientsocketpipelinesink$boss.connect(nioclientsocketpipelinesink)。java:401)在org.jboss.netty.channel.socket.nio.nioclientsocketpipelinesink$boss.processselectedkeys(nioclientsocketpipelinesink)。java:370)位于org.jboss.netty.channel.socket.nio.nioclientsocketpipelinesink$boss.run(nioclientsocketpipelinesink)。java:292)

az31mfrm

az31mfrm1#

首先在本地计算机上使用avro source运行flume代理,然后使用avro sink运行flume代理。原因是avrosource启动绑定在给定ip和端口的avrorpc服务器。avrosink是一个avrorpc客户机,它监听avrorpc服务器并向其发送flume事件。

相关问题