安装hadoop 7682修补程序后无法运行hadoop程序

gr8qqesn  于 2021-06-03  发布在  Hadoop
关注(0)|答案(0)|浏览(388)

我是hadoop新手。我正在使用Windows7和cygwin在Hadoop1.2.1上工作。我的是单节点系统。我意识到每当我运行mapreduce脚本文件时任务跟踪器都没有启动,因此我应用了来自的hadoop7682补丁https://github.com/congainc/patch-hadoop_7682-1.0.x-win 解决问题
我将jar文件添加到libs文件夹,还修改了核心站点xml文件。现在,我可以运行任务跟踪器了。但是,现在如果我尝试运行任何使用mapreduce的程序,例如,使用mahout clustering命令或任何与mapreduce相关的命令。

  1. $MAHOUT_HOME/bin/mahout org.apache.mahout.clustering.syntheticcontrol.kmeans.Job

我得到下面的错误
线程“main”java.lang.runtimeexception中的异常:java.lang.classnotfoundexception解决方案

  1. $ bin/mahout org.apache.mahout.clustering.syntheticcontrol.kmeans.Job MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
  2. hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally
  3. SLF4J: Class path contains multiple SLF4J bindings.
  4. SLF4J: Found binding in [jar:file:/C:/Mahout/trunk/examples/target/mahout-examples-0.9-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  5. SLF4J: Found binding in [jar:file:/C:/Mahout/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  6. SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
  7. SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory]
  8. Aug 27, 2013 5:53:44 PM org.slf4j.impl.JCLLoggerAdapter warn
  9. WARNING: No org.apache.mahout.clustering.syntheticcontrol.kmeans.Job.props found on classpath, will use command-line arguments only
  10. Aug 27, 2013 5:53:45 PM org.slf4j.impl.JCLLoggerAdapter info
  11. INFO: Running with default arguments
  12. Aug 27, 2013 5:53:53 PM org.slf4j.impl.JCLLoggerAdapter info
  13. INFO: Preparing Input
  14. Aug 27, 2013 5:53:55 PM org.apache.hadoop.mapred.JobClient copyAndConfigureFiles
  15. WARNING: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  16. Aug 27, 2013 5:53:55 PM org.apache.hadoop.mapred.JobClient$2 run
  17. INFO: Cleaning up the staging area hdfs://localhost:9000/tmp/hadoop-USER/mapred/staging/USER/.staging/job_201308271750_0001
  18. Exception in thread "main" java.lang.RuntimeException: java.lang.ClassNotFoundException: com.conga.services.hadoop.patch.HADOOP_7682.WinLocalFileSystem
  19. at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:857)
  20. at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1440)
  21. at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
  22. at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)
  23. at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)
  24. at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:234)
  25. at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1230)
  26. at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1206)
  27. at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1178)
  28. at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:864)
  29. at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:734)
  30. at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:179)
  31. at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:951)
  32. at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
  33. at java.security.AccessController.doPrivileged(Native Method)
  34. at javax.security.auth.Subject.doAs(Subject.java:415)
  35. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
  36. at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
  37. at org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
  38. at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
  39. at org.apache.mahout.clustering.conversion.InputDriver.runJob(InputDriver.java:108)
  40. at org.apache.mahout.clustering.syntheticcontrol.kmeans.Job.run(Job.java:130)
  41. at org.apache.mahout.clustering.syntheticcontrol.kmeans.Job.main(Job.java:60)
  42. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  43. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  44. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  45. at java.lang.reflect.Method.invoke(Method.java:601)
  46. at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
  47. at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
  48. at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
  49. Caused by: java.lang.ClassNotFoundException: com.conga.services.hadoop.patch.HADOOP_7682.WinLocalFileSystem
  50. at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
  51. at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
  52. at java.security.AccessController.doPrivileged(Native Method)
  53. at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
  54. at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
  55. at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
  56. at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
  57. at java.lang.Class.forName0(Native Method)
  58. at java.lang.Class.forName(Class.java:264)
  59. at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:810)
  60. at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:855)
  61. ... 29 more

我是不是漏了什么?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题