hadoop程序在“java-jar”中运行良好，但在“Hadoopjar”中运行不好

mgdq6dx1  于 2021-05-30  发布在  Hadoop
关注(0)|答案(2)|浏览(430)

我编写了一个连接到两个hbase数据库的mapreduce程序。我在eclipse上编写了它，并使用“runnable jar”选项（与所有库一起）导出了它。它运行得很好 java -jar 命令。输出是下一个：

  1. $ java -jar mr.jar
  2. log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
  3. log4j:WARN Please initialize the log4j system properly.
  4. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

然后是预期输出。但是，如果我用 hadoop jar 我不知道到底发生了什么，但我猜什么都没有。预期输出未显示。

  1. $ hadoop jar mr.jar
  2. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
  3. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
  4. 14/09/10 17:22:07 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
  5. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
  6. 14/09/10 17:22:07 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
  7. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
  8. 14/09/10 17:22:07 INFO Configuration.deprecation: dfs.df.interval is deprecated. Instead, use fs.df.interval
  9. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
  10. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
  11. 14/09/10 17:22:07 INFO Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
  12. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
  13. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
  14. 14/09/10 17:22:07 INFO Configuration.deprecation: io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
  15. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
  16. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
  17. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
  18. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
  19. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
  20. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
  21. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
  22. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
  23. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
  24. 14/09/10 17:22:07 INFO Configuration.deprecation: jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
  25. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
  26. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
  27. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
  28. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
  29. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
  30. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
  31. 14/09/10 17:22:07 INFO Configuration.deprecation: io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
  32. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
  33. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
  34. 14/09/10 17:22:07 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
  35. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
  36. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb
  37. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
  38. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
  39. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
  40. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
  41. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
  42. 14/09/10 17:22:07 INFO Configuration.deprecation: io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
  43. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
  44. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
  45. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
  46. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
  47. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.child.java.opts is deprecated. Instead, use mapreduce.reduce.java.opts
  48. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
  49. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
  50. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
  51. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
  52. 14/09/10 17:22:07 INFO Configuration.deprecation: mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
  53. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
  54. 14/09/10 17:22:07 INFO Configuration.deprecation: job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
  55. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
  56. 14/09/10 17:22:07 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
  57. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
  58. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
  59. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
  60. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
  61. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
  62. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
  63. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
  64. 14/09/10 17:22:07 INFO Configuration.deprecation: keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
  65. 14/09/10 17:22:07 INFO Configuration.deprecation: tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
  66. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
  67. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
  68. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.map.child.java.opts is deprecated. Instead, use mapreduce.map.java.opts
  69. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
  70. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
  71. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
  72. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
  73. 14/09/10 17:22:07 INFO Configuration.deprecation: jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
  74. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
  75. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
  76. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
  77. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
  78. 14/09/10 17:22:07 INFO Configuration.deprecation: jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
  79. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
  80. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
  81. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
  82. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
  83. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
  84. 14/09/10 17:22:07 INFO Configuration.deprecation: job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
  85. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
  86. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
  87. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
  88. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
  89. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
  90. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
  91. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
  92. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
  93. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
  94. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
  95. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
  96. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
  97. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
  98. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
  99. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb
  100. 14/09/10 17:22:07 INFO Configuration.deprecation: topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
  101. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
  102. 14/09/10 17:22:07 INFO Configuration.deprecation: dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
  103. 14/09/10 17:22:07 INFO Configuration.deprecation: topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
  104. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
  105. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
  106. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
  107. 14/09/10 17:22:07 INFO Configuration.deprecation: mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
  108. 14/09/10 17:22:08 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
  109. 14/09/10 17:22:08 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
  110. 14/09/10 17:22:08 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
  111. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
  112. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
  113. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
  114. 14/09/10 17:22:08 INFO Configuration.deprecation: fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
  115. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.block.size is deprecated. Instead, use dfs.blocksize
  116. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
  117. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
  118. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
  119. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
  120. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
  121. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
  122. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
  123. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
  124. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
  125. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
  126. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
  127. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
  128. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
  129. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
  130. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
  131. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
  132. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
  133. 14/09/10 17:22:08 INFO Configuration.deprecation: fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
  134. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
  135. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
  136. 14/09/10 17:22:08 INFO Configuration.deprecation: dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
  137. 14/09/10 17:22:08 INFO Configuration.deprecation: fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
  138. 14/09/10 17:22:08 INFO client.RMProxy: Connecting to ResourceManager at /192.168.0.1:8032
  139. 14/09/10 17:22:08 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
  140. 14/09/10 17:22:08 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
  141. 14/09/10 17:22:08 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
  142. 14/09/10 17:22:08 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
  143. 14/09/10 17:22:08 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
  144. 14/09/10 17:22:08 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
  145. 14/09/10 17:22:08 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
  146. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
  147. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:host.name=xxx
  148. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_55
  149. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
  150. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.55.x86_64/jre
  151. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.class.path=[...]
  152. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/opt/hadoop/hadoop-2.2.0/lib/native
  153. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
  154. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
  155. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
  156. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
  157. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-431.17.1.el6.x86_64
  158. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:user.name=xxx
  159. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/xxx
  160. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/xxx/programas
  161. 14/09/10 17:22:08 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x18dddc42, quorum=localhost:2181, baseZNode=/hbase
  162. 14/09/10 17:22:08 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x18dddc42 connecting to ZooKeeper ensemble=localhost:2181
  163. 14/09/10 17:22:08 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
  164. 14/09/10 17:22:08 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
  165. 14/09/10 17:22:08 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x14859c8510b004c, negotiated timeout = 90000
  166. 14/09/10 17:22:09 INFO mapreduce.TableOutputFormat: Created table instance for s
  167. 14/09/10 17:22:09 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
  168. 14/09/10 17:22:11 INFO util.RegionSizeCalculator: Calculating region sizes for table "e".
  169. 14/09/10 17:22:11 WARN mapreduce.TableInputFormatBase: Cannot resolve the host name for hadoop2/192.168.0.2 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '2.0.168.192.in-addr.arpa'
  170. 14/09/10 17:22:12 INFO mapreduce.JobSubmitter: number of splits:1
  171. 14/09/10 17:22:12 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
  172. 14/09/10 17:22:12 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
  173. 14/09/10 17:22:12 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
  174. 14/09/10 17:22:12 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
  175. 14/09/10 17:22:12 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
  176. 14/09/10 17:22:12 INFO Configuration.deprecation: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
  177. 14/09/10 17:22:12 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
  178. 14/09/10 17:22:12 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
  179. 14/09/10 17:22:12 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
  180. 14/09/10 17:22:12 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1405689757338_0555
  181. 14/09/10 18:26:53 INFO impl.YarnClientImpl: Submitted application application_1405689757338_0560 to ResourceManager at /192.168.0.1:8032
  182. 14/09/10 18:26:53 INFO mapreduce.Job: The url to track the job: http://xxx.xxx.xxx:8088/proxy/application_1405689757338_0560/
  183. 14/09/10 18:26:53 INFO mapreduce.Job: Running job: job_1405689757338_0560
  184. 14/09/10 18:27:18 INFO mapreduce.Job: Job job_1405689757338_0560 running in uber mode : false
  185. 14/09/10 18:27:18 INFO mapreduce.Job:  map 0% reduce 0%
  186. 14/09/10 18:37:46 INFO mapreduce.Job: Task Id : attempt_1405689757338_0560_m_000000_0, Status : FAILED
  187. AttemptID:attempt_1405689757338_0560_m_000000_0 Timed out after 600 secs
  188. 14/09/10 18:48:17 INFO mapreduce.Job: Task Id : attempt_1405689757338_0560_m_000000_1, Status : FAILED
  189. AttemptID:attempt_1405689757338_0560_m_000000_1 Timed out after 600 secs
  190. 14/09/10 18:58:47 INFO mapreduce.Job: Task Id : attempt_1405689757338_0560_m_000000_2, Status : FAILED
  191. AttemptID:attempt_1405689757338_0560_m_000000_2 Timed out after 600 secs
  192. 14/09/10 19:09:18 INFO mapreduce.Job:  map 100% reduce 100%
  193. 14/09/10 19:09:19 INFO mapreduce.Job: Job job_1405689757338_0560 failed with state FAILED due to: Task failed task_1405689757338_0560_m_000000
  194. Job failed as tasks failed. failedMaps:1 failedReduces:0
  196. 14/09/10 19:09:19 INFO mapreduce.Job: Counters: 9
  197.     Job Counters 
  198.         Failed map tasks=4
  199.         Launched map tasks=4
  200.         Other local map tasks=3
  201.         Rack-local map tasks=1
  202.         Total time spent by all maps in occupied slots (ms)=25139550
  203.         Total time spent by all reduces in occupied slots (ms)=0
  204.     Map-Reduce Framework
  205.         CPU time spent (ms)=0
  206.         Physical memory (bytes) snapshot=0
  207.         Virtual memory (bytes) snapshot=0
  208. Exception in thread "main" java.io.IOException: JOB ERROR.
  209.     at Principal.main(Principal.java:44)
  210.     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  211.     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  212.     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  213.     at java.lang.reflect.Method.invoke(Method.java:606)
  214.     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

非常感谢。

JavahadoophbaseeclipseJar

2条答案

按热度按时间
i7uaboj4

i7uaboj41#

看起来，hadoop默认jar不是从hadoop类路径获取的，请确保jar中添加的jar在hadoop类路径中引用。

赞(0）分享  回复(0）举报  2021-05-30
omvjsjqw

omvjsjqw2#

与hadoop安装相比，您的输出看起来有一个旧的配置文件。如果尚未自定义配置文件，则可能需要刷新；否则，您必须检查所有警告并确保它们不重要。
“结束”错误输出表示您正在运行的程序具有某种类型的本机编译组件。如果您将其提交到分布式map/reduce集群，那么系统如何知道如何调用本机库？本机库是否分布到所有节点，并且位于相同的文件位置？您是否设置了java本机库路径，以便在每次执行map/reduce任务时在每个系统上都包含这个位置？

赞(0）分享  回复(0）举报  2021-05-30
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com