我试图在hdinsights上学习hadoop版本1.1.0。我循序渐进地在hadoop命令行上运行命令。我首先编译java代码,然后创建一个jar文件,然后执行map reduce命令。但是当我运行mapreduce命令时,它给出了下面的错误。有人能帮我理解错误的含义吗?我需要做些什么来纠正错误?
c:\hadoop-training\mrdcache>hadoop jar DCache.jar DCache mrdcache/input/nyse mrdcache/output
13/08/08 23:29:01 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/08/08 23:29:01 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:8020/hadoop/hdfs/tmp/mapred/staging/Ramya/.staging/job_201308082321_0001
13/08/08 23:29:01 ERROR security.UserGroupInformation: PriviledgedActionException as:myusername cause:java.io.FileNotFoundException: File does not exist: mrdcache/output Exception in thread "main" java.io.FileNotFoundException: File does not exist: mrdcache/output
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:518)
at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:750)
at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
at DCache.main(Dcache.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
谢谢你的帮助!谢谢,拉姆亚
1条答案
按热度按时间31moq8wy1#
档案在哪里?您应该这样使用asv:hadoop jar c:\tutorials\log4jmapreduce.jar log4jmapreduce asv:///sample.log asv:///tutorials/output
http://www.windowsazure.com/en-us/manage/services/hdinsight/using-mapreduce-with-hdinsight/