hadoop应用程序失败mapreduce成功

9rbhqvlz  于 2021-06-02  发布在  Hadoop
关注(0)|答案(2)|浏览(565)

我对hadoop 2（hadoop 2.2.0）比较陌生，不明白为什么资源管理器上的m/r job~应用程序被标记为失败：

  1. application_1399458460502_0015  pig Max temperature MAPREDUCE   default Wed, 04 Jun 2014 17:16:52 GMT   Wed, 04 Jun 2014 17:17:30 GMT   FAILED  FAILED   History

当我知道m/r作业已成功完成，甚至作业历史服务器也声称已成功时：

  1. 2014.06.04 13:16:52 EDT 2014.06.04 13:17:19 EDT job_1399458460502_0015  Max temperature pig default SUCCEEDED   2   2   1   1

我不明白为什么申请被标记为失败。我在jobhistory服务器-日志上看到的唯一错误如下：

  1. 2014-06-04 13:17:19,628 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
  2. 2014-06-04 13:17:19,628 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
  3. 2014-06-04 13:17:19,628 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
  4. 2014-06-04 13:17:19,629 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
  5. 2014-06-04 13:17:19,736 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://namenodeha/user/pig/.staging/job_1399458460502_0015/job_1399458460502_0015_1.jhist to hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015-1401902212831-pig-Max+temperature-1401902239623-2-1-SUCCEEDED-default.jhist_tmp
  6. 2014-06-04 13:17:19,812 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015-1401902212831-pig-Max+temperature-1401902239623-2-1-SUCCEEDED-default.jhist_tmp
  7. 2014-06-04 13:17:19,824 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://namenodeha/user/pig/.staging/job_1399458460502_0015/job_1399458460502_0015_1_conf.xml to hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015_conf.xml_tmp
  8. 2014-06-04 13:17:19,835 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:1 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
  9. 2014-06-04 13:17:19,880 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015_conf.xml_tmp
  10. 2014-06-04 13:17:19,914 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015.summary_tmp to hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015.summary
  11. 2014-06-04 13:17:19,925 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015_conf.xml_tmp to hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015_conf.xml
  12. 2014-06-04 13:17:19,937 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015-1401902212831-pig-Max+temperature-1401902239623-2-1-SUCCEEDED-default.jhist_tmp to hdfs://namenodeha/mr-history/tmp/pig/job_1399458460502_0015-1401902212831-pig-Max+temperature-1401902239623-2-1-SUCCEEDED-default.jhist
  13. 2014-06-04 13:17:19,938 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
  14. 2014-06-04 13:17:19,940 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to 
  15. 2014-06-04 13:17:20,060 ERROR [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception while unregistering 
  16. java.lang.NullPointerException
  17.     at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:133)
  18.     at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:148)
  19.     at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:207)
  20.     at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:177)
  21.     at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:250)
  22.     at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:255)
  23.     at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
  24.     at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
  25.     at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:817)
  26.     at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
  27.     at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
  28.     at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
  29.     at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:159)
  30.     at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
  31.     at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
  32.     at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.shutDownJob(MRAppMaster.java:548)
  33.     at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler$1.run(MRAppMaster.java:599)
  34. 2014-06-04 13:17:20,061 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:1 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
  35. 2014-06-04 13:17:20,062 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Skipping cleaning up the staging dir. assuming AM will be retried.
  36. 2014-06-04 13:17:20,062 INFO [Thread-62] org.apache.hadoop.ipc.Server: Stopping server on 43851
  37. 2014-06-04 13:17:20,064 INFO [IPC Server listener on 43851] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 43851
  38. 2014-06-04 13:17:20,065 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  39. 2014-06-04 13:17:20,065 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
  40. 2014-06-04 13:17:25,066 INFO [Thread-62] org.apache.hadoop.ipc.Server: Stopping server on 44771
  41. 2014-06-04 13:17:25,066 INFO [IPC Server listener on 44771] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 44771
  42. 2014-06-04 13:17:25,067 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
  43. 2014-06-04 13:17:25,072 INFO [Thread-62] org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:0
  44. 2014-06-04 13:17:25,172 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Exiting MR AppMaster..GoodBye!
  45. 2014-06-04 13:17:25,173 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a signal. Signaling RMCommunicator and JobHistoryEventHandler.
  46. 2014-06-04 13:17:25,173 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that iSignalled is: true
  47. 2014-06-04 13:17:25,173 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: false
  48. 2014-06-04 13:17:25,173 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: false
  49. 2014-06-04 13:17:25,173 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: false
  50. 2014-06-04 13:17:25,174 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is false

或从资源管理器：

  1. Application application_1399458460502_0015 failed 2 times due to AM Container for appattempt_1399458460502_0015_000002 exited with exitCode: 1 due to: Exception from container-launch:
  2. org.apache.hadoop.util.Shell$ExitCodeException:
  3. at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
  4. at org.apache.hadoop.util.Shell.run(Shell.java:379)
  5. at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
  6. at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
  7. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
  8. at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
  9. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  10. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  11. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  12. at java.lang.Thread.run(Thread.java:744)
  13. .Failing this attempt.. Failing the application

这些错误都没有给我一点线索。我的配置如下：

  1. <?xml version="1.0"?>
  2. <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
  3. <configuration>
  4.     <!--internal property-->
  5.     <property>
  6.         <name>bigdata.conf.identification</name>
  7.         <value>cluster-DEV1</value>
  8.         <final>true</final>
  9.     </property>
  11.     <!--hadoop properties-->
  12.     <!-- Put site-specific property overrides in this file. -->
  14.     <!--hbase-site-->
  15.     <property>
  16.         <name>hbase.zookeeper.quorum</name>
  17.         <value>bd-prg-dev1-nn1,bd-prg-dev1-nn2,bd-prg-dev1-rm1</value>
  18.     </property>
  19.     <property>
  20.         <name>zookeeper.session.timeout</name>
  21.         <value>60000</value>
  22.     </property>
  23.     <property>
  24.         <name>hbase.zookeeper.property.clientPort</name>
  25.         <value>2181</value>
  26.     </property>
  27.     <property>
  28.         <name>zookeeper.znode.parent</name>
  29.         <value>/hbase-unsecure</value>
  30.     </property>
  32.     <!--core-site-->
  33.     <property>
  34.         <name>hadoop.security.authentication</name>
  35.         <value>simple</value>
  36.     </property>
  37.     <property>
  38.         <name>ipc.client.connect.max.retries</name>
  39.         <value>50</value>
  40.     </property>
  41.     <property>
  42.         <name>ipc.client.connection.maxidletime</name>
  43.         <value>30000</value>
  44.     </property>
  46.     <property>
  47.         <name>ipc.client.idlethreshold</name>
  48.         <value>8000</value>
  49.     </property>
  50.     <property>
  51.         <name>io.compression.codecs</name>
  52.         <value>org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec</value>
  53.     </property>
  54.     <property>
  55.         <name>io.serializations</name>
  56.         <value>org.apache.hadoop.io.serializer.WritableSerialization</value>
  57.     </property>
  58.     <property>
  59.         <name>hadoop.security.authorization</name>
  60.         <value>false</value>
  61.     </property>
  62.     <property>
  63.         <name>fs.defaultFS</name>
  64.         <value>hdfs://namenodeha</value>
  65.     </property>
  66.     <property>
  67.         <name>ha.zookeeper.quorum</name>
  68.         <value>bd-prg-dev1-nn1:2181,bd-prg-dev1-nn2:2181,bd-prg-dev1-rm1:2181</value>
  69.     </property>
  71.     <!-- hdfs-site-->
  72.     <property>
  73.         <name>dfs.namenode.http-address</name>
  74.         <value>bd-prg-dev1-nn1:50070</value>
  75.     </property>
  76.     <property>
  77.         <name>dfs.datanode.ipc.address</name>
  78.         <value>0.0.0.0:8010</value>
  79.     </property>
  80.     <property>
  81.         <name>dfs.journalnode.http-address</name>
  82.         <value>0.0.0.0:8480</value>
  83.     </property>
  84.     <property>
  85.         <name>dfs.namenode.accesstime.precision</name>
  86.         <value>0</value>
  87.     </property>
  88.     <property>
  89.         <name>dfs.namenode.stale.datanode.interval</name>
  90.         <value>30000</value>
  91.     </property>
  92.     <property>
  93.         <name>dfs.datanode.address</name>
  94.         <value>0.0.0.0:50010</value>
  95.     </property>
  96.     <property>
  97.         <name>dfs.datanode.http.address</name>
  98.         <value>0.0.0.0:50075</value>
  99.     </property>
  100.     <property>
  101.         <name>dfs.namenode.secondary.http-address</name>
  102.         <value>bd-prg-dev1-nn2:50090</value>
  103.     </property>
  104.     <property>
  105.         <name>dfs.nameservices</name>
  106.         <value>namenodeha</value>
  107.         <description>Logical name for this new nameservice</description>
  108.     </property>
  109.     <property>
  110.         <name>dfs.ha.namenodes.namenodeha</name>
  111.         <value>nn1,nn2</value>
  112.         <description>Unique identifiers for each NameNode in the nameservice</description>
  113.     </property>
  114.     <property>
  115.         <name>dfs.namenode.rpc-address.namenodeha.nn1</name>
  116.         <value>bd-prg-dev1-nn1:8020</value>
  117.     </property>
  118.     <property>
  119.         <name>dfs.namenode.rpc-address.namenodeha.nn2</name>
  120.         <value>bd-prg-dev1-nn2:8020</value>
  121.     </property>
  122.     <property>
  123.         <name>dfs.namenode.http-address.namenodeha.nn1</name>
  124.         <value>bd-prg-dev1-nn1:50070</value>
  125.     </property>
  126.     <property>
  127.         <name>dfs.namenode.http-address.namenodeha.nn2</name>
  128.         <value>bd-prg-dev1-nn2:50070</value>
  129.     </property>
  130.     <property>
  131.         <name>dfs.client.failover.proxy.provider.namenodeha</name>
  132.         <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
  133.     </property>
  135.     <!--yarn-site-->
  136.     <property>
  137.         <name>yarn.nodemanager.address</name>
  138.         <value>0.0.0.0:45454</value>
  139.     </property>
  140.     <property>
  141.         <name>yarn.nodemanager.container-monitor.interval-ms</name>
  142.         <value>3000</value>
  143.     </property>
  144.     <property>
  145.         <name>yarn.nodemanager.remote-app-log-dir</name>
  146.         <value>/app-logs</value>
  147.     </property>
  148.     <property>
  149.         <name>yarn.log.server.url</name>
  150.         <value>bd-prg-dev1-rm1:19888/jobhistory/logs</value>
  151.     </property>
  152.     <property>
  153.         <name>yarn.resourcemanager.admin.address</name>
  154.         <value>bd-prg-dev1-rm1:8141</value>
  155.     </property>
  156.     <property>
  157.         <name>yarn.resourcemanager.resource-tracker.address</name>
  158.         <value>bd-prg-dev1-rm1:8025</value>
  159.     </property>
  160.     <property>
  161.         <name>yarn.nodemanager.aux-services</name>
  162.         <value>mapreduce_shuffle</value>
  163.     </property>
  164.     <property>
  165.         <name>yarn.nodemanager.log-aggregation.compression-type</name>
  166.         <value>gz</value>
  167.     </property>
  168.     <property>
  169.         <name>yarn.nodemanager.health-checker.script.path</name>
  170.         <value>/etc/hadoop/conf/health_check</value>
  171.     </property>
  172.     <property>
  173.         <name>yarn.nodemanager.container-executor.class</name>
  174.         <value>org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor</value>
  175.     </property>
  176.     <property>
  177.         <name>yarn.nodemanager.remote-app-log-dir-suffix</name>
  178.         <value>logs</value>
  179.     </property>
  180.     <property>
  181.         <name>yarn.resourcemanager.webapp.address</name>
  182.         <value>bd-prg-dev1-rm1:8088</value>
  183.     </property>
  184.     <property>
  185.         <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
  186.         <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  187.     </property>
  188.     <property>
  189.         <name>yarn.resourcemanager.address</name>
  190.         <value>bd-prg-dev1-rm1:8050</value>
  191.     </property>
  192.     <property>
  193.         <name>yarn.log-aggregation-enable</name>
  194.         <value>true</value>
  195.     </property>
  196.     <property>
  197.         <name>yarn.resourcemanager.scheduler.address</name>
  198.         <value>bd-prg-dev1-rm1:8030</value>
  199.     </property>
  201.     <!--mapred-site-->
  202.     <property>
  203.         <name>mapreduce.jobhistory.intermediate-done-dir</name>
  204.         <value>/mr-history/tmp</value>
  205.     </property>
  206.     <property>
  207.         <name>mapreduce.jobhistory.done-dir</name>
  208.         <value>/mr-history/done</value>
  209.     </property>
  210.     <property>
  211.         <name>mapreduce.jobhistory.webapp.address</name>
  212.         <value>bd-prg-dev1-rm1:19888</value>
  213.     </property>
  214.     <property>
  215.         <name>mapreduce.jobtracker.system.dir</name>
  216.         <value>/mapred/system</value>
  217.     </property>
  218.     <property>
  219.         <name>mapreduce.framework.name</name>
  220.         <value>yarn</value>
  221.     </property>
  222. </configuration>

客户端控制台的输出：

  1. [pig@hadooptools Hadoop]$ hadoop jar Jobs/hadoop-mr-poc-1.0-SNAPSHOT.jar com.ncr.bigdata.mr.MaxTemperatureDriver -conf clientConf/cluster/hadoop-client.xmlMRtest/input /MRtest/output/1
  2. 14/06/04 12:17:37 INFO mr.MaxTemperatureDriver: Job Max temperature submitted
  3. 14/06/04 12:17:37 INFO client.RMProxy: Connecting to ResourceManager at bd-prg-dev1-rm1/153.86.208.210:8050
  4. 14/06/04 12:17:37 INFO client.RMProxy: Connecting to ResourceManager at bd-prg-dev1-rm1/153.86.208.210:8050
  5. 14/06/04 12:17:38 INFO mapred.FileInputFormat: Total input paths to process : 1
  6. 14/06/04 12:17:38 INFO net.NetworkTopology: Adding a new node: /default-rack/153.86.208.208:50010
  7. 14/06/04 12:17:38 INFO net.NetworkTopology: Adding a new node: /default-rack/153.86.208.249:50010
  8. 14/06/04 12:17:39 INFO mapreduce.JobSubmitter: number of splits:2
  9. 14/06/04 12:17:39 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
  10. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
  11. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
  12. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
  13. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
  14. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
  15. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
  16. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
  17. 14/06/04 12:17:39 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
  18. 14/06/04 12:17:39 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1399458460502_0015
  19. 14/06/04 12:17:39 INFO impl.YarnClientImpl: Submitted application application_1399458460502_0015 to ResourceManager at bd-prg-dev1-rm1/153.86.208.210:8050
  20. 14/06/04 12:17:39 INFO mapreduce.Job: The url to track the job: http://bd-prg-dev1-rm1:8088/proxy/application_1399458460502_0015/
  21. 14/06/04 12:17:39 INFO mapreduce.Job: Running job: job_1399458460502_0015
  22. 14/06/04 12:17:46 INFO mapreduce.Job: Job job_1399458460502_0015 running in uber mode : false
  23. 14/06/04 12:17:46 INFO mapreduce.Job:  map 0% reduce 0%
  24. 14/06/04 12:17:59 INFO mapreduce.Job:  map 100% reduce 0%
  25. 14/06/04 12:18:07 INFO mapreduce.Job:  map 100% reduce 100%
  26. 14/06/04 12:18:31 INFO ipc.Client: Retrying connect to server: bd-prg-dev1-dn1/153.86.208.208:44771. Already tried 0 time(s); maxRetries=45
  27. 14/06/04 12:18:51 INFO ipc.Client: Retrying connect to server: bd-prg-dev1-dn1/153.86.208.208:44771. Already tried 1 time(s); maxRetries=45
  28. 14/06/04 12:19:11 INFO ipc.Client: Retrying connect to server: bd-prg-dev1-dn1/153.86.208.208:44771. Already tried 2 time(s); maxRetries=45
  29. 14/06/04 12:33:14 INFO ipc.Client: Retrying connect to server: bd-prg-dev1-dn1/153.86.208.208:44771. Already tried 44 time(s); maxRetries=45
  30. 14/06/04 12:33:35 INFO mapreduce.Job:  map 0% reduce 0%
  31. 14/06/04 12:33:35 INFO mapreduce.Job: Job job_1399458460502_0015 failed with state FAILED due to: Application application_1399458460502_0015 failed 2 times due to AM Container for appattempt_1399458460502_0015_000002 exited with  exitCode: 1 due to: Exception from container-launch:
  32. org.apache.hadoop.util.Shell$ExitCodeException:
  33.         at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
  34.         at org.apache.hadoop.util.Shell.run(Shell.java:379)
  35.         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
  36.         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
  37.         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
  38.         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
  39.         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  40.         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  41.         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  42.         at java.lang.Thread.run(Thread.java:744)
  44. .Failing this attempt.. Failing the application.
  45. 14/06/04 12:33:35 INFO mapreduce.Job: Counters: 0
  46. Exception in thread "main" java.io.IOException: Job failed!
  47.         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
  48.         at com.ncr.bigdata.mr.MaxTemperatureDriver.run(MaxTemperatureDriver.java:46)
  49.         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  50.         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
  51.         at com.ncr.bigdata.mr.MaxTemperatureDriver.main(MaxTemperatureDriver.java:54)
  52.         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  53.         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  54.         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  55.         at java.lang.reflect.Method.invoke(Method.java:606)
  56.         at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

有人猜出什么问题了吗？

hadoopmapreduceyarnresourcemanager

2条答案

按热度按时间
omqzjyyz

omqzjyyz1#

当无法从配置中找到某些内容时，似乎会出现这种问题(正如原始答案所暗示的那样）。
在我的情况下，我发现当我做一个Pig的行动，我需要参考一个 site.xml ，工作流的相关部分现在如下所示：

  1. <action name="read-into-table">
  2.         <pig>
  3.             <job-tracker>${jobTracker}</job-tracker>
  4.             <name-node>${nameNode}</name-node>
  5.             <job-xml>site.xml</job-xml>
  6.             <configuration>
  7.                 <property>
  8.                     <name>mapred.job.queue.name</name>
  9.                     <value>${queueName}</value>
  10.                 </property>
  11.             </configuration>
  12.             <script>myFile.pig</script>
  13.         </pig>
  14.         <ok to="end" />
  15.         <error to="fail" />
  16. </action>

缺少以下行：

  1. <job-xml>site.xml</job-xml>
展开查看全部
赞(0）分享  回复(0）举报  2021-06-03
j5fpnvbx

j5fpnvbx2#

我不太清楚它是哪个配置属性，但是当我从集群中获取配置并用它创建配置对象时，它工作得很好。

赞(0）分享  回复(0）举报  2021-06-03
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com