hadoop流在本地异常上失败:java.net.socketexception:主机已关闭;

afdcj2ne  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(350)

我有一个1节点的集群在我的mac上运行,可以在hdfs中创建一个目录并放置一个文件

hadoop fs -mkdir sampleData
hadoop fs -put ~/SampleTweets.csv sampleData

但当我运行一个简单的流式处理作业时,得到一个错误(如下代码所示)

hadoop jar    
~/cloudera/cdh5.5/hadoop/share/hadoop/mapreduce1/contrib/streaming/hadoop-
streaming-2.6.0-mr1-cdh5.5.1.jar \
-Dmapred.reduce.tasks=1 \
-input sampleData \
-output sampleData/output1 \
-mapper cat \
-reducer "wc -l"

屏幕错误和http://localhost:8088/群集/应用程序/应用程序\u 1453348020587 \u 0005

Application application_1453348020587_0005 failed 2 times due to Error launching appattempt_1453348020587_0005_000002. 
Got exception: java.io.IOException: Failed on local exception: java.net.SocketException: 
Host is down; Host Details : local host is: "tanna-iMac.local/192.168.1.13"; 
destination host is: "192.168.1.4":58893;

我的/etc/主机:

cat /etc/hosts
  127.0.0.1 localhost
  255.255.255.255   broadcasthost
  192.168.1.13 localhost
  ::1 localhost
  fe80::1%lo0   localhost

不确定它从何处获取目标主机192.168.1.4?在58893端口上运行什么服务

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题