节点管理器无法在Hadoop2.6.0中启动(连接被拒绝)

wlwcrazw  于 2021-06-03  发布在  Hadoop
关注(0)|答案(2)|浏览(506)

我已经在ec2示例（ubuntu14.04 64位）中安装了hadoop2.6.0多节点集群。主计算机中的所有恶魔（namenode、secondarynamenode、resourcemanager）都已启动，但从计算机中只有datanode已启动nodemanager由于连接被拒绝而关闭。
请在这方面帮助我。提前谢谢
我的nodemanager的日志文件如下：

  1. 2015-09-08 07:59:36,606 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (992.5 M). Thrashing might happen.
  2. 2015-09-08 07:59:36,613 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8
  3. 2015-09-08 07:59:36,646 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  4. 2015-09-08 07:59:36,666 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 53949
  5. 2015-09-08 07:59:36,688 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
  6. 2015-09-08 07:59:36,688 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.
  7. 2015-09-08 07:59:36,691 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  8. 2015-09-08 07:59:36,692 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 53949: starting
  9. 2015-09-08 07:59:36,707 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : ec2-52-88-167-9.us-west-2.compute.amazonaws.com:53949
  10. 2015-09-08 07:59:36,713 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
  11. 2015-09-08 07:59:36,713 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040
  12. 2015-09-08 07:59:36,716 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
  13. 2015-09-08 07:59:36,717 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
  14. 2015-09-08 07:59:36,717 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting
  15. 2015-09-08 07:59:36,717 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040
  16. 2015-09-08 07:59:36,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154:53949
  17. 2015-09-08 07:59:36,719 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0
  18. 2015-09-08 07:59:36,719 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042
  19. 2015-09-08 07:59:36,790 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  20. 2015-09-08 07:59:36,793 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined
  21. 2015-09-08 07:59:36,805 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
  22. 2015-09-08 07:59:36,806 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
  23. 2015-09-08 07:59:36,806 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
  24. 2015-09-08 07:59:36,807 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
  25. 2015-09-08 07:59:36,812 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/*
  26. 2015-09-08 07:59:36,812 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
  27. 2015-09-08 07:59:36,820 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042
  28. 2015-09-08 07:59:36,820 INFO org.mortbay.log: jetty-6.1.26
  29. 2015-09-08 07:59:36,863 INFO org.mortbay.log: Extract jar:file:/home/ubuntu/hadoop/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp
  30. 2015-09-08 07:59:37,358 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
  31. 2015-09-08 07:59:37,359 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042
  32. 2015-09-08 07:59:37,879 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
  33. 2015-09-08 07:59:37,885 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8031
  34. 2015-09-08 07:59:37,913 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
  35. 2015-09-08 07:59:37,917 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
  37. **2015-09-08 07:59:38,951 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  39. 2015-09-08 07:59:39,956 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  40. 2015-09-08 07:59:40,957 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  41. 2015-09-08 07:59:41,957 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  42. 2015-09-08 07:59:42,958 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)**
  44. 2015-09-08 08:19:48,256 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in state STARTED; cause:**org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.ConnectException: Call From ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154 to 0.0.0.0:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
  45. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.ConnectException: Call From ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154 to 0.0.0.0:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused**
  46.         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197)
  47.         at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
  48.         at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
  49.         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264)
  50.         at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
  51.         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463)
  52.         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)
  53. Caused by: java.net.ConnectException: Call From ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154 to 0.0.0.0:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
  54.         at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
  55.         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  56.         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
  57.         at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
  58.         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
  59.         at org.apache.hadoop.ipc.Client.call(Client.java:1472)
  60.         at org.apache.hadoop.ipc.Client.call(Client.java:1399)
  61.         at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
  62.         at com.sun.proxy.$Proxy27.registerNodeManager(Unknown Source)
  63.         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:68)
  64.         at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
  65.         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  66.         at java.lang.reflect.Method.invoke(Method.java:606)
  67.         at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  68.         at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  69.         at com.sun.proxy.$Proxy28.registerNodeManager(Unknown Source)
  70.         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:257)
  71.         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:191)
  72.         ... 6 more
  73. Caused by: java.net.ConnectException: Connection refused
  74.         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
  75. at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
  76.         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
  77.         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
  78.         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
  79.         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:607)
  80.         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
  81.         at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
  82.         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
  83.         at org.apache.hadoop.ipc.Client.call(Client.java:1438)
  84.         ... 18 more
  85. 2015-09-08 08:19:48,257 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.ConnectException: Call From ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154 to 0.0.0.0:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
  86. org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.ConnectException: Call From ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154 to 0.0.0.0:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
  87.         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197)
  88.         at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
  89.         at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
  90.         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264)
  91.         at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
  92.         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463)
  93.         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)
  94. Caused by: java.net.ConnectException: Call From ec2-52-88-167-9.us-west-2.compute.amazonaws.com/172.31.29.154 to 0.0.0.0:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
  95.         at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
  96.         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  97.         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
  98.         at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
  99.         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
  100.         at org.apache.hadoop.ipc.Client.call(Client.java:1472)
  101.         at org.apache.hadoop.ipc.Client.call(Client.java:1399)
  102.         at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
  103.         at com.sun.proxy.$Proxy27.registerNodeManager(Unknown Source)
  104.         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:68)
  105.         at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
  106.         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  107.         at java.lang.reflect.Method.invoke(Method.java:606)
  108.         at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
  109.         at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
  110.         at com.sun.proxy.$Proxy28.registerNodeManager(Unknown Source)
  111.         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:257)
  112.         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:191)
  113.         ... 6 more
  114. Caused by: java.net.ConnectException: Connection refused
  115.         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
  116.         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
  117.         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
  118.         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
  119.         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
  120.         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:607)
  121.         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
  122.         at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
  123.         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
  124.         at org.apache.hadoop.ipc.Client.call(Client.java:1438)
  125.         ... 18 more
  126. 2015-09-08 08:19:48,263 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
  127. 2015-09-08 08:19:48,264 INFO org.apache.hadoop.ipc.Server: Stopping server on 53949
  128. 2015-09-08 08:19:48,266 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 53949
  129. 2015-09-08 08:19:48,267 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  130. 2015-09-08 08:19:48,267 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting.
  131. 2015-09-08 08:19:48,267 INFO org.apache.hadoop.ipc.Server: Stopping server on 8040
  132. 2015-09-08 08:19:48,268 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8040
  133. 2015-09-08 08:19:48,268 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  134. 2015-09-08 08:19:48,269 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Public cache exiting
  135. 2015-09-08 08:19:48,269 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system...
  136. 2015-09-08 08:19:48,270 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped.
  137. 2015-09-08 08:19:48,270 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete.
  138. 2015-09-08 08:19:48,270 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager

core-site.xml：

  1. <configuration>
  2.   <property>
  3.     <name>fs.default.name</name>
  4.     <value>hdfs://ec2-52-26-161-203.us-west-2.compute.amazonaws.com:8020</value>
  5.   </property>
  6.   <property>
  7.     <name>hadoop.tmp.dir</name>
  8.     <value>/home/ubuntu/hdfstmp</value>
  9.   </property>
  10. </configuration>

mapred-site.xml:

  1. <configuration>
  2.       <property>
  3.         <name>mapred.job.tracker</name>
  4.         <value>hdfs://ec2-52-26-161-203.us-west-2.compute.amazonaws.com:8021</value>
  5.       </property>
  6.     </configuration>

hdfs-site.xml：

  1. <configuration>
  2.     <property>
  3.       <name>dfs.replication</name>
  4.       <value>2</value>
  5.     </property>
  6.     <property>
  7.       <name>dfs.permissions</name>
  8.       <value>false</value>
  9.     </property>
  10.  </configuration>

主机：
ubuntu@ec2-52-26-161-203：~$vim/etc/主机

  1. 172.31.23.167 ec2-52-26-161-203.us-west-2.compute.amazonaws.com
  3. # The following lines are desirable for IPv6 capable hosts
  5. ::1 ip6-localhost ip6-loopback
  6. fe00::0 ip6-localnet
  7. ff00::0 ip6-mcastprefix
  8. ff02::1 ip6-allnodes
  9. ff02::2 ip6-allrouters
  10. ff02::3 ip6-allhosts

ubuntu@ec2-52-26-161-203：~$vim/etc/hadoop/masters

  1. ec2-52-26-161-203.us-west-2.compute.amazonaws.com

ubuntu@ec2-52-26-161-203用法：~$vim/etc/hadoop/slaves

  1. ec2-52-88-167-9.us-west-2.compute.amazonaws.com

从机：
ubuntu@ec2-52-88-167-9：~vim/etc/hosts

  1. 172.31.29.154 ec2-52-88-167-9.us-west-2.compute.amazonaws.com
  3. # The following lines are desirable for IPv6 capable hosts
  5. ::1 ip6-localhost ip6-loopback
  6. fe00::0 ip6-localnet
  7. ff00::0 ip6-mcastprefix
  8. ff02::1 ip6-allnodes
  9. ff02::2 ip6-allrouters
  10. ff02::3 ip6-allhosts

ubuntu@ec2-52-88-167-9：~vim/etc/hadoop/slaves

  1. ec2-52-88-167-9.us-west-2.compute.amazonaws.com

ubuntu@ec2-52-26-161-203：~$sudo netstat-lpten | grep java

  1. tcp        0      0 0.0.0.0:50070           0.0.0.0:*               LISTEN      1000       569904      19910/java      
  2. tcp        0      0 0.0.0.0:50090           0.0.0.0:*               LISTEN      1000       570916      20136/java      
  3. tcp        0      0 172.31.23.167:8020      0.0.0.0:*               LISTEN      1000       569911      19910/java      
  4. tcp6       0      0 :::8088                 :::*                    LISTEN      1000       571699      20278/java      
  5. tcp6       0      0 :::8030                 :::*                    LISTEN      1000       571690      20278/java      
  6. tcp6       0      0 :::8031                 :::*                    LISTEN      1000       571683      20278/java      
  7. tcp6       0      0 :::8032                 :::*                    LISTEN      1000       571695      20278/java      
  8. tcp6       0      0 :::8033                 :::*                    LISTEN      1000       571702      20278/java

telnet命令：
ubuntu@ec2-52-26-161-203：~$telnet localhost 8031

  1. Trying ::1...
  2. Connected to localhost.
  3. Escape character is '^]'.

资源管理器的8031端口怎么样？我还没有给出我的hadoop配置文件（coresite.xml、mapred site.xml、hdfs site.xml），它们都在上面。

hadooplinuxamazon-ec2connection-refusedclient-server

2条答案

按热度按时间
2nbm6dog

2nbm6dog1#

我在mapred-site.xml和yarn-site.xml中进行了修改，解决了我的问题。因为我没有在yarn-site.xml中提到资源管理器的主机名属性值，所以它试图连接到地址0.0.0.0，这是导致连接被拒绝异常的原因。
mapred-site.xml文件

  1. <property>
  2.     <name>mapreduce.framework.name</name>
  3.     <value>yarn</value>
  4. </property>

yarn-site.xml文件

  1. <property>
  2.     <name>yarn.resourcemanager.hostname</name>
  3.     <value>ec2-52-26-161-203.us-west-2.compute.amazonaws.com</value>
  4. </property>
赞(0）分享  回复(0）举报  2021-06-03
6ju8rftf

6ju8rftf2#

hadoop文档http://wiki.apache.org/hadoop/connectionrefused 清楚地说：
请确保异常中的目标地址不是0.0.0.0—这意味着您实际上没有为该客户端配置真正的地址
你能试着在从机的主机和从机的ip条目中添加主ip条目吗。如果不需要，还可以注解掉hosts文件中的所有条目。

赞(0）分享  回复(0）举报  2021-06-03
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com