datanode的hadoop主路径

e5nszbig  于 2021-06-03  发布在  Hadoop
关注(0)|答案(0)|浏览(276)

我正在ec2中配置一个3节点hadoop集群。
对于namenode和jobtracker:

  1. export HADOOP_HOME=/usr/local/hadoop # Masternode
  2. export PATH=$PATH:$HADOOP_HOME/bin
  3. export PATH=$PATH:$HADOOP_HOME/sbin
  4. export HADOOP_MAPRED_HOME=${HADOOP_HOME}
  5. export HADOOP_COMMON_HOME=${HADOOP_HOME}
  6. export HADOOP_HDFS_HOME=${HADOOP_HOME}
  7. export YARN_HOME=${HADOOP_HOME}
  8. export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
  9. export HDFS_CONF_DIR=${HADOOP_HOME}/etc/hadoop
  10. export YARN_CONF_DIR=${HADOOP_HOME}/etc/hadoop
  11. export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_HOME}/lib/native
  12. export HADOOP_OPTS="-Djava.library.path=${HADOOP_HOME}/lib"

对于datanode,我附加了附加的ebs存储,它安装在/vol上,

  1. export HADOOP_HOME=/vol/hadoop
  2. export PATH=$PATH:$HADOOP_HOME/bin
  3. export PATH=$PATH:$HADOOP_HOME/sbin
  4. export HADOOP_MAPRED_HOME=${HADOOP_HOME}
  5. export HADOOP_COMMON_HOME=${HADOOP_HOME}
  6. export HADOOP_HDFS_HOME=${HADOOP_HOME}
  7. export YARN_HOME=${HADOOP_HOME}
  8. export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
  9. export HDFS_CONF_DIR=${HADOOP_HOME}/etc/hadoop
  10. export YARN_CONF_DIR=${HADOOP_HOME}/etc/hadoop
  11. export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_HOME}/lib/native
  12. export HADOOP_OPTS="-Djava.library.path=${HADOOP_HOME}/lib"

当我尝试在namenode上运行start-dfs.sh时,出现以下错误,

  1. data01.hdp-dev.XYZ.com: bash: line 0: cd: /usr/local/hadoop: No such file or directory
  2. data01.hdp-dev.XYZ.com: bash: /usr/local/hadoop/sbin/hadoop-daemon.sh: No such file or directory

注意namenode试图从错误的目录从datanode调用hadoop。。。
任何建议都会有帮助。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题