datanode和namenode运行,但不反映在ui中

3j86kqsm  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(416)

我在hadoop中配置主节点和从节点时遇到了一个小挫折,我的namenode和datanode都在主节点和从节点中启动并运行。
但是,webui中的livenodes计数没有得到反映,但是节点正在运行。
我已经尝试禁用防火墙和格式化节点,但我无法解决相同的问题。
任何帮助都将不胜感激!!!
以下是片段:
硕士学位:
jps命令输出:
5088日元
4446名称节点
4681次要名称节点
从机:
jps命令输出:
2478日元
2410数据节点

ubuntu@hadoop-master:/usr/local/hadoop/etc/hadoop$ $HADOOP_HOME/bin/hdfs dfsadmin -refreshNodes
16/04/28 02:22:37 WARN ipc.Client: Address change detected. Old: hadoop-master/52.200.230.29:50077 New: hadoop-master/127.0.0.1:50077
refreshNodes: Call From hadoop-master/127.0.0.1 to hadoop-master:50077 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

hadoop-slave-1的日志文件:

2016-04-28 21:23:07,248 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:12,257 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:17,265 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:22,273 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:27,282 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000
2016-04-28 21:23:32,291 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000

hadoop主机的日志文件:

2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 127.0.0.1
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Rolling edit logs
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 407
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 22
2016-04-28 21:21:04,003 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 23
2016-04-28 21:21:04,003 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /usr/local/hadoop/hadoop_data/hdfs/namenode/current/edits_inprogress_0000000000000000407 -> /usr/local/hadoop/hadoop_data/hdfs/namenode/current/edits_0000000000000000407-0000000000000000408
2016-04-28 21:21:04,004 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 409

netstat-pant命令:

ubuntu@hadoop-master:/usr/local/hadoop/etc/hadoop$ netstat -pant
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:50070           0.0.0.0:*               LISTEN      21491/java
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -
tcp        0      0 0.0.0.0:50077           0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:50078         0.0.0.0:*               LISTEN      21491/java
tcp        0      0 0.0.0.0:9000            0.0.0.0:*               LISTEN      -
tcp        0      0 0.0.0.0:50090           0.0.0.0:*               LISTEN      21726/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57225      ESTABLISHED 21491/java
tcp        0      0 127.0.0.1:41471         127.0.0.1:50078         TIME_WAIT   -
tcp        0    124 172.31.63.189:22        128.235.8.68:56950      ESTABLISHED -
tcp        0      0 172.31.63.189:50070     128.235.8.68:57224      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57223      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:22        128.235.8.68:57084      ESTABLISHED -
tcp        0      0 172.31.63.189:22        58.218.204.215:39402    ESTABLISHED -
tcp        0      0 172.31.63.189:50070     128.235.8.68:57227      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57228      ESTABLISHED 21491/java
tcp        0      0 172.31.63.189:50070     128.235.8.68:57226      ESTABLISHED 21491/java
tcp6       0      0 :::22                   :::*                    LISTEN      -
tcp6       0      0 :::50077                :::*                    LISTEN      -
tcp6       0      0 :::9000                 :::*                    LISTEN      -
pbossiut

pbossiut1#

我可以从你的帖子中看到这个错误。我想你需要做三件事
确保50077端口是由进程侦听的,并且是您的hadoop进程
确保可以使用telnet之类的工具访问它
除了防火墙。selinux也会影响访问。因此,请关闭它并重新启动服务,然后重试

相关问题