whirr:hadoop-proxy.sh不工作

pu3pd22g  于 2021-06-04  发布在  Hadoop
关注(0)|答案(0)|浏览(160)

我已经安装了whirr并创建了一个ec2集群。集群创建正确,我可以ssh到节点并检查hadoop是否正常工作。但是,每当我尝试使用hadoop-proxy.sh时,都会收到以下消息:

  1. bind: Cannot assign requested address

如果我尝试在另一个shell中查看hdfs(我之前配置了hadoop\u conf\u dir变量),则会出现以下错误:

  1. 13/11/29 05:15:09 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively
  2. Bad connection to FS. command aborted. exception: Server IPC version 7 cannot communicate with client version 4

我试过在设置集群时使用不同的属性文件,使用cdh,而不使用它。。。但我还是犯了同样的错误。这是我当前用来启动集群的属性文件,whirr:

  1. whirr.cluster-name=otrotest
  2. whirr.instance-templates=1 hadoop-namenode+yarn-resourcemanager+mapreduce-historyserver,2 hadoop-datanode+yarn-nodemanager
  3. whirr.provider=aws-ec2
  4. whirr.identity=MY_ID
  5. whirr.credential=MY_SECRET_KEY
  6. whirr.private-key-file=/home/hduser/.ssh/whirr_id_rsa
  7. whirr.public-key-file=/home/hduser/.ssh/whirr_id_rsa.pub
  8. whirr.env.MAPREDUCE_VERSION=2
  9. whirr.env.repo=cdh4
  10. whirr.hadoop.install-function=install_cdh_hadoop
  11. whirr.hadoop.configure-function=configure_cdh_hadoop
  12. whirr.mr_jobhistory.start-function=start_cdh_mr_jobhistory
  13. whirr.yarn.configure-function=configure_cdh_yarn
  14. whirr.yarn.start-function=start_cdh_yarn
  15. whirr.hardware-id=t1.micro
  16. whirr.image-id=us-west-2/ami-6aad335a
  17. whirr.location-id=us-west-2
  18. whirr.java.install-function=install_openjdk
  19. whirr.java.install-function=install_oab_java

我是新来的,我想我错过了一些东西。。。但我不知道怎么解决这个问题。任何帮助都将不胜感激。提前谢谢。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题