我已经安装了whirr并创建了一个ec2集群。集群创建正确,我可以ssh到节点并检查hadoop是否正常工作。但是,每当我尝试使用hadoop-proxy.sh时,都会收到以下消息:
bind: Cannot assign requested address
如果我尝试在另一个shell中查看hdfs(我之前配置了hadoop\u conf\u dir变量),则会出现以下错误:
13/11/29 05:15:09 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively
Bad connection to FS. command aborted. exception: Server IPC version 7 cannot communicate with client version 4
我试过在设置集群时使用不同的属性文件,使用cdh,而不使用它。。。但我还是犯了同样的错误。这是我当前用来启动集群的属性文件,whirr:
whirr.cluster-name=otrotest
whirr.instance-templates=1 hadoop-namenode+yarn-resourcemanager+mapreduce-historyserver,2 hadoop-datanode+yarn-nodemanager
whirr.provider=aws-ec2
whirr.identity=MY_ID
whirr.credential=MY_SECRET_KEY
whirr.private-key-file=/home/hduser/.ssh/whirr_id_rsa
whirr.public-key-file=/home/hduser/.ssh/whirr_id_rsa.pub
whirr.env.MAPREDUCE_VERSION=2
whirr.env.repo=cdh4
whirr.hadoop.install-function=install_cdh_hadoop
whirr.hadoop.configure-function=configure_cdh_hadoop
whirr.mr_jobhistory.start-function=start_cdh_mr_jobhistory
whirr.yarn.configure-function=configure_cdh_yarn
whirr.yarn.start-function=start_cdh_yarn
whirr.hardware-id=t1.micro
whirr.image-id=us-west-2/ami-6aad335a
whirr.location-id=us-west-2
whirr.java.install-function=install_openjdk
whirr.java.install-function=install_oab_java
我是新来的,我想我错过了一些东西。。。但我不知道怎么解决这个问题。任何帮助都将不胜感激。提前谢谢。
暂无答案!
目前还没有任何答案,快来回答吧!