在cdh3上运行级联代码时出错-在缓存中找不到令牌

htrmnn0y  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(344)

在运行级联代码时,有人能帮我解决以下错误吗?错误发生在 CoGroup() 用于连接两个数据流。如果将这两个数据流分别输出到一个接收器中,则这两个数据流是正常的。
我使用的是级联2.0和hadoop0.20.2-cdh3u5。

12/12/07 13:52:46 INFO flow.Flow: [my_tst]  parallel execution is enabled: true
12/12/07 13:52:46 INFO flow.Flow: [my_tst]  starting jobs: 2
12/12/07 13:52:46 INFO flow.Flow: [my_tst]  allocating threads: 2
12/12/07 13:52:46 INFO flow.FlowStep: [my_tst] at least one sink does not exist
12/12/07 13:52:46 INFO flow.FlowStep: [my_tst] source modification date at: Thu Dec 06 10:15:32 EST 2012
12/12/07 13:52:46 INFO flow.FlowStep: [my_tst] starting step: (2/2)
12/12/07 13:52:47 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 24769 for wagnerj
12/12/07 13:52:47 INFO security.TokenCache: Got dt for hdfs://nyxxx002.lab.dev:8020/user/wagnerj/.staging/job_201212070841_0008;…..
12/12/07 13:52:47 WARN snappy.LoadSnappy: Snappy native library is available
12/12/07 13:52:47 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/12/07 13:52:47 INFO snappy.LoadSnappy: Snappy native library loaded
12/12/07 13:52:47 INFO mapred.FileInputFormat: Total input paths to process : 1
12/12/07 13:52:47 INFO flow.FlowStep: [my_tst] submitted hadoop job: job_201212070841_0008
12/12/07 13:53:17 INFO flow.FlowStep: [my_tst] starting step: (1/2) cascd2
12/12/07 13:53:17 INFO mapred.FileInputFormat: Total input paths to process : 1
12/12/07 13:53:17 INFO mapred.FileInputFormat: Total input paths to process : 36
12/12/07 13:53:17 INFO mapred.JobClient: Cleaning up the staging area hdfs://nyxxx002.lab.dev:8020/user/wagnerj/.staging/job_201212070841_0009
12/12/07 13:53:17 ERROR security.UserGroupInformation: PriviledgedActionException as:wagnerj@LAB.DEV (auth:KERBEROS) cause:org.apache.hadoop.ipc.RemoteException: java.io.IOException: org.apache.hadoop.ipc.RemoteException: token (owner=wagnerj@LAB.DEV, renewer=mapred, realUser=, issueDate=1354906367141, maxDate=1355511167141, sequenceNumber=24769, masterKeyId=356) can't be found in cache
    at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3469)
    at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3437)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

相关问题