error security.usergroupinformation:priviledgedactionexception

w8biq8rn  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(384)

我试图在hdinsights上学习hadoop版本1.1.0。我循序渐进地在hadoop命令行上运行命令。我首先编译java代码,然后创建一个jar文件,然后执行map reduce命令。但是当我运行mapreduce命令时,它给出了下面的错误。有人能帮我理解错误的含义吗?我需要做些什么来纠正错误?

c:\hadoop-training\mrdcache>hadoop jar DCache.jar DCache mrdcache/input/nyse mrdcache/output

13/08/08 23:29:01 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/08/08 23:29:01 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:8020/hadoop/hdfs/tmp/mapred/staging/Ramya/.staging/job_201308082321_0001
13/08/08 23:29:01 ERROR security.UserGroupInformation: PriviledgedActionException as:myusername cause:java.io.FileNotFoundException: File does not exist: mrdcache/output Exception in thread "main" java.io.FileNotFoundException: File does not exist: mrdcache/output
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:518)
    at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:750)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
    at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
    at DCache.main(Dcache.java:199)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

谢谢你的帮助!谢谢,拉姆亚

31moq8wy

31moq8wy1#

档案在哪里?您应该这样使用asv:hadoop jar c:\tutorials\log4jmapreduce.jar log4jmapreduce asv:///sample.log asv:///tutorials/output
http://www.windowsazure.com/en-us/manage/services/hdinsight/using-mapreduce-with-hdinsight/

相关问题