ambari hdp 2.2:端口8020连接被拒绝

zkure5ic  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(585)

因此,我在一个由三节点awsec2示例组成的集群上安装了ambari。所有服务都显示为绿色,也就是说,它们似乎都运行良好。我可以做所有的hdfs文件操作。但是,每当我尝试在示例上运行一个简单的wordcount程序时,它都会说它无法到达端口8020。

  1. $ hadoop jar /usr/hdp/2.2.6.3-1/hadoop-mapreduce/hadoop-mapreduce-examples-2.6.0.2.2.6.3-1.jar wordcount /tmp/wordcount/in /tmp/wordcount/out
  2. 15/08/21 05:28:02 INFO impl.TimelineClientImpl: Timeline service address: http://<fqdn for the namenode>:8188/ws/v1/timeline/
  3. 15/08/21 05:28:02 INFO client.RMProxy: Connecting to ResourceManager at <fqdn for the namenode>/10.0.0.55:8050
  4. java.io.FileNotFoundException: File does not exist: hdfs://<fqdn for the namenode>:8020/hdp/apps/2.2.6.3-1/mapreduce/mapreduce.tar.gz
  5. at org.apache.hadoop.fs.Hdfs.getFileStatus(Hdfs.java:137)
  6. at org.apache.hadoop.fs.AbstractFileSystem.resolvePath(AbstractFileSystem.java:460)
  7. at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2180)
  8. at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2176)
  9. at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
  10. at org.apache.hadoop.fs.FileContext.resolve(FileContext.java:2176)
  11. at org.apache.hadoop.fs.FileContext.resolvePath(FileContext.java:595)
  12. at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:753)
  13. at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:435)
  14. at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
  15. at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
  16. at java.security.AccessController.doPrivileged(Native Method)
  17. at javax.security.auth.Subject.doAs(Subject.java:415)
  18. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
  19. at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
  20. at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314)
  21. at org.apache.hadoop.examples.WordCount.main(WordCount.java:87)
  22. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  23. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  24. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  25. at java.lang.reflect.Method.invoke(Method.java:606)
  26. at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
  27. at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
  28. at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
  29. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  30. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  31. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  32. at java.lang.reflect.Method.invoke(Method.java:606)
  33. at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
  34. at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

fqdn是命令的输出 hostname -f 创建群集时使用的。
我也尝试过telnet,但是有太多的连接被拒绝了。

  1. bt-prod-dev-02@ip-10-0-0-55:~$ telnet localhost 8020
  2. Trying 127.0.0.1...
  3. telnet: Unable to connect to remote host: Connection refused

我不知道该去哪儿找。

ie3xauqp

ie3xauqp1#

这是一个简单的“filenotfoundexception”,我希望ambari安装能够处理这个问题。所以我把文件放进去后问题就解决了 /usr/hdp/2.2.6.3-1/hadoop/mapreduce.tar.gzhdfs://<fqdn for the namenode>:8020/hdp/apps/2.2.6.3-1/mapreduce/ .

相关问题