在Hadoop2.2.0上,我的datanode无法启动

x8goxv8g  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(583)

各位,我在构建hadoop集群时遇到了一个小问题
我的节点安装centos 6.5、java1.7.60和hadoop 2.2.0
我想造一个主人和三个奴隶
我试着这样建造它
但最后,我尝试启动namenode和datanode
我的/etc/主机如下:

  1. 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
  2. ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
  3. 10.10.10.10 master
  4. 10.10.10.11 slave1
  5. 10.10.10.12 slave2
  6. 10.10.10.13 slave3

就像我打字时这样:

  1. $ hadoop namenode -fromat:
  2. java.net.UnknownHostException: hadoop01.hadoopcluster: hadoop01.hadoopcluster
  3. at java.net.InetAddress.getLocalHost(InetAddress.java:1473)
  4. at org.apache.hadoop.net.DNS.resolveLocalHostname(DNS.java:264)
  5. at org.apache.hadoop.net.DNS.<clinit>(DNS.java:57)
  6. at org.apache.hadoop.hdfs.server.namenode.NNStorage.newBlockPoolID(NNStorage.java:914)
  7. at org.apache.hadoop.hdfs.server.namenode.NNStorage.newNamespaceInfo(NNStorage.java:550)
  8. at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:144)
  9. at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:837)
  10. at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1213)
  11. at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
  12. Caused by: java.net.UnknownHostException: hadoop01.hadoopcluster
  13. at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
  14. at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
  15. at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
  16. at java.net.InetAddress.getLocalHost(InetAddress.java:1469)
  17. ... 8 more
  18. 14/07/01 16:50:46 WARN net.DNS: Unable to determine address of the host-falling back to "localhost" address
  19. java.net.UnknownHostException: hadoop01.hadoopcluster: hadoop01.hadoopcluster
  20. at java.net.InetAddress.getLocalHost(InetAddress.java:1473)
  21. at org.apache.hadoop.net.DNS.resolveLocalHostIPAddress(DNS.java:287)
  22. at org.apache.hadoop.net.DNS.<clinit>(DNS.java:58)
  23. at org.apache.hadoop.hdfs.server.namenode.NNStorage.newBlockPoolID(NNStorage.java:914)
  24. at org.apache.hadoop.hdfs.server.namenode.NNStorage.newNamespaceInfo(NNStorage.java:550)
  25. at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:144)
  26. at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:837)
  27. at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1213)
  28. at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
  29. Caused by: java.net.UnknownHostException: hadoop01.hadoopcluster
  30. at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
  31. at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
  32. at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
  33. at java.net.InetAddress.getLocalHost(InetAddress.java:1469)
  34. ... 8 more

并尝试发出start-dfs.sh和start-yarn.sh:

  1. $ start-dfs.sh
  2. 14/07/01 16:55:23 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  3. Starting namenodes on [master]
  4. master: namenode running as process 2395. Stop it first.
  5. slave2: starting datanode, logging to /opt/hadoop/logs/hadoop-hadoop-datanode-hadoop03.hadopcluster.out
  6. slave1: starting datanode, logging to /opt/hadoop/logs/hadoop-hadoop-datanode-hadoop02.hadopcluster.out
  7. slave3: starting datanode, logging to /opt/hadoop/logs/hadoop-hadoop-datanode-hadoop04.hadopcluster.out
  8. Starting secondary namenodes [0.0.0.0]
  9. 0.0.0.0: secondarynamenode running as process 2564. Stop it first.
  10. 14/07/01 16:55:31 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  11. $ start-yarn.sh
  12. starting yarn daemons
  13. starting resourcemanager, logging to /opt/hadoop/logs/yarn-hadoop-resourcemanager-hadoop01.hadoopcluster.out
  14. slave1: starting nodemanager, logging to /opt/hadoop/logs/yarn-hadoop-nodemanager-hadoop02.hadopcluster.out
  15. slave3: starting nodemanager, logging to /opt/hadoop/logs/yarn-hadoop-nodemanager-hadoop04.hadopcluster.out
  16. slave2: starting nodemanager, logging to /opt/hadoop/logs/yarn-hadoop-nodemanager-hadoop03.hadopcluster.out

和类型jps:

  1. $ jps
  2. 2564 SecondaryNameNode
  3. 5591 Jps
  4. 2395 NameNode

我只是这样,没有数据节点,节点管理器,资源管理器。。。等等,我设置的时候有什么地方不对吗?谁能给我提个建议吗,谢谢!

c86crjj0

c86crjj01#

dhcp(动态主机配置协议)
它是部署在ip网络上的服务器,用于为其客户机分配ip地址。因此,您必须在服务器端和客户端上配置dhcp。
在服务器端:
获取程序包: isc-dhcp-server 编辑/ etc/network 接口要配置接口,请为dhcp服务器选择静态ip地址
指定dhcp将侦听的本地网络接口( /etc/default/isc-dhcp-server )
编辑配置文件 /etc/dhcp/dhcpd.conf 要选择本地网络将使用的ip地址,请定义dns服务器
在客户端:
编辑/etc/网络接口以配置接口
您可以确保它是良好的安装和配置,您可以使用 ifconfig 以及 ping 命令。
域名系统
进水 bind9 编辑 /etc/bind/named.conf 添加主机
祝你好运。

相关问题