hadoopYarn无法启动

o2gm4chl  于 2021-07-15  发布在  Hadoop
关注(0)|答案(0)|浏览(361)

我在windows10上有hadoop-3.2.2。
我在这里安装的
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/clustersetup.html
一切都很好,直到我试着开始
sbin/start-yarn.sh文件
这会产生错误

  1. 2021-01-28 00:13:05,968 ERROR util.SysInfoWindows: ExitCodeException exitCode=1: PdhAddCounter \Network Interface(*)\Bytes Received/Sec failed with 0xc0000bb8.
  2. Error in GetDiskAndNetwork. Err:1
  3. at org.apache.hadoop.util.Shell.runCommand(Shell.java:1008)
  4. at org.apache.hadoop.util.Shell.run(Shell.java:901)
  5. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1213)
  6. at org.apache.hadoop.util.SysInfoWindows.getSystemInfoInfoFromShell(SysInfoWindows.java:86)
  7. at org.apache.hadoop.util.SysInfoWindows.refreshIfNeeded(SysInfoWindows.java:101)
  8. at org.apache.hadoop.util.SysInfoWindows.getPhysicalMemorySize(SysInfoWindows.java:153)
  9. at org.apache.hadoop.yarn.util.ResourceCalculatorPlugin.getPhysicalMemorySize(ResourceCalculatorPlugin.java:64)
  10. at org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl$MonitoringThread.run(NodeResourceMonitorImpl.java:143)
  11. 2021-01-28 00:13:09,882 INFO impl.MetricsSystemImpl: Stopping NodeManager metrics system...
  12. 2021-01-28 00:13:09,884 INFO impl.MetricsSystemImpl: NodeManager metrics system stopped.
  13. 2021-01-28 00:13:09,885 INFO impl.MetricsSystemImpl: NodeManager metrics system shutdown complete.

环境变量

  1. HADOOP_HOME=~/hadoop/hadoop-3.3.0/bin
  2. PATH=$PATH:$HADOOP_HOME/bin
  3. PATH=$PATH:$HADOOP_HOME/sbin
  4. HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
  5. HADOOP_MAPRED_HOME=$HADOOP_HOME
  6. HADOOP_COMMON_HOME=$HADOOP_HOME
  7. HADOOP_HDFS_HOME=$HADOOP_HOME
  8. YARN_HOME=$HADOOP_HOME

这是我的配置文件
core-site.xml文件

  1. <configuration>
  2. <property>
  3. <name>fs.defaultFS</name>
  4. <!-- <value>hdfs://localhost:9000</value> -->
  5. <value>hdfs://0.0.0.0:19000</value>
  6. </property>
  7. </configuration>

hdfs-site.xml文件

  1. <configuration>
  2. <property>
  3. <name>dfs.replication</name>
  4. <value>1</value>
  5. </property>
  6. <property>
  7. <name>dfs.namenode.name.dir</name>
  8. <value>file:///D:/Dev/Hadoop/hadoop-3.1.0/data/namenode</value>
  9. <!-- <value>/disk1/hdfs/name,/remote/hdfs/name</value> -->
  10. </property>
  11. <property>
  12. <name>dfs.datanode.data.dir</name>
  13. <value>file:///D:/Dev/Hadoop/hadoop-3.1.0/data/datanode</value>
  14. <!-- <value>/disk1/hdfs/data,/disk2/hdfs/data</value> -->
  15. </property>

mapred-site.xml文件

  1. <configuration>
  2. <property>
  3. <name>mapreduce.framework.name</name>
  4. <value>yarn</value>
  5. </property>
  6. <property>
  7. <name>mapreduce.application.classpath</name>
  8. <value>
  9. HADOOP_HOME;/share/hadoop/mapreduce/*,;
  10. HADOOP_HOME;/share/hadoop/mapreduce/lib/*,;
  11. HADOOP_HOME;/share/hadoop/common/*,;
  12. HADOOP_HOME;/share/hadoop/common/lib/*,;
  13. HADOOP_HOME;/share/hadoop/yarn/*,;
  14. HADOOP_HOME;/share/hadoop/yarn/lib/*,;
  15. HADOOP_HOME;/share/hadoop/hdfs/*,;
  16. HADOOP_HOME;/share/hadoop/hdfs/lib/*</value>
  17. </property>
  18. </configuration>

yarn-site.xml文件

  1. <configuration>
  2. <property>
  3. <name>yarn.nodemanager.aux-services</name>
  4. <value>mapreduce_shuffle</value>
  5. </property>
  6. <property>
  7. <name>yarn.nodemanager.env-whitelist</name>
  8. <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
  9. </property>
  10. </configuration>

我搞不懂为什么Yarn不起头

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题