hadoop无法启动从属“致命错误”

ddhy6vgd  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(424)

我开始我的hadoop与4奴隶和所有工作正常,除了一台机器。我用同样的方法创造了它们。
运行./start-all.sh时收到的错误是:

  1. xxxxx: starting tasktracker, logging to /xxxxx/xxxxx/hadoop/logs/hadoop-xxxxx-tasktracker-xxxxx.out
  2. xxxxx: /xxxxx/xxxxx/hadoop/hadoop-0.20/bin/hadoop: line 413: 7012 Aborted nohup $_JAVA_EXEC -Dproc_$COMMAND $JAVA_HEAP_MAX $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@" >"$_HADOOP_DAEMON_OUT" 2>&1 </dev/null

日志的详细信息:

  1. /************************************************************
  2. STARTUP_MSG: Starting DataNode
  3. STARTUP_MSG: host = xxxxx/144.99.120.153
  4. STARTUP_MSG: args = []
  5. STARTUP_MSG: version = 0.20.2-cdh3u5
  6. STARTUP_MSG: build = file:///data/1/xxxxx/topdir/BUILD/hadoop-0.20.2-cdh3u5 -r 580d1d26c7ad6a7c6ba72950d8605e2c6fbc96cc; compiled by 'root' on Mon Aug 6 20:20:46 PDT 2012
  7. ************************************************************/
  8. 02:29:24.395 [main] DEBUG org.apache.hadoop.security.Groups - Creating new Groups object
  9. 02:29:24.513 [main] DEBUG org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
  10. 02:29:24.529 [main] DEBUG o.a.h.security.UserGroupInformation - hadoop login
  11. 02:29:24.529 [main] DEBUG o.a.h.security.UserGroupInformation - hadoop login commit
  12. 02:29:24.531 [main] DEBUG o.a.h.security.UserGroupInformation - using local user:UnixPrincipal:xxxxx
  13. 02:29:24.533 [main] DEBUG o.a.h.security.UserGroupInformation - UGI loginUser:xxxxx (auth:SIMPLE)
  14. 02:29:24.604 [main] DEBUG org.apache.hadoop.fs.FileSystem - Creating filesystem for file:///
  15. 02:29:24.627 [main] WARN org.apache.hadoop.util.DiskChecker - Incorrect permissions were set on /xxxxx/xxxxx/hadoop-hdfs-dev/dfs/data, expected: rwx------, while actual: rwxr-----. Fixing...
  16. 02:29:24.630 [main] DEBUG o.a.hadoop.util.NativeCodeLoader - Trying to load the custom-built native-hadoop library...
  17. #
  18. # A fatal error has been detected by the Java Runtime Environment:
  19. #
  20. # SIGFPE (0x8) at pc=0x0000002a9555d827, pid=6924, tid=1076017504
  21. #
  22. # JRE version: 6.0_25-b06
  23. # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.0-b11 mixed mode linux-amd64 compressed oops)
  24. # Problematic frame:
  25. # C [ld-linux-x86-64.so.2+0x7827] double+0xe7
  26. #
  27. # An error report file with more information is saved as:
  28. # /xxxxx/xxxxx/xxxxx/hadoop/hadoop-0.20/hs_err_pid6924.log
  29. #
  30. # If you would like to submit a bug report, please visit:
  31. # http://java.sun.com/webapps/bugreport/crash.jsp
  32. # The crash happened outside the Java Virtual Machine in native code.
  33. # See problematic frame for where to report the bug.

第三个日志的详细信息是:

  1. --------------- T H R E A D ---------------
  2. Current thread (0x0000000040122000): JavaThread "main" [_thread_in_native, id=6926, stack(0x000000004012b000,0x000000004022c000)]
  3. siginfo:si_signo=SIGFPE: si_errno=0, si_code=1 (FPE_INTDIV), si_addr=0x0000002a9555d827
  4. Registers:
  5. RAX=0x000000000f4d007f, RBX=0x0000002a9d2ab8b8, RCX=0x0000000040228700, RDX=0x0000000000000000
  6. RSP=0x00000000402285e0, RBP=0x00000000402287b0, RSI=0x0000002a9b6c1080, RDI=0x0000002a9b2afe70
  7. R8 =0x0000002a9d2ab8a8, R9 =0x0000000000000000, R10=0x0000000040228838, R11=0x0000000000000000
  8. R12=0x0000002a9b6c1080, R13=0x0000002a9d0a633c, R14=0x0000000000000000, R15=0x0000000000000000
  9. RIP=0x0000002a9555d827, EFLAGS=0x0000000000010246, CSGSFS=0x000000000000a940, ERR=0x0000000000000000
  10. TRAPNO=0x0000000000000000
  11. Top of Stack: (sp=0x00000000402285e0)
  12. 0x00000000402285e0: 0000000040228740 0000002a955919c8
  13. 0x00000000402285f0: 0000000040228580 0000001095560de4
  14. 0x0000000040228600: 0000000000000000 000000009678c130
  15. 0x0000000040228610: 0000002a967f86b8 0000002a967f7f30
  16. ...............
  17. Stack: [0x000000004012b000,0x000000004022c000], sp=0x0000000040228870, free space=1014k
  18. Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
  19. C [ld-linux-x86-64.so.2+0x7827] double+0xe7
  20. C [ld-linux-x86-64.so.2+0x8fc0] _dl_relocate_object+0x410
  21. C [libc.so.6+0xf8558] double+0x238
  22. C [ld-linux-x86-64.so.2+0xae00] _dl_catch_error+0x60
  23. C [libdl.so.2+0x1054] double+0x34
  24. Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
  25. j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;)V+0
  26. j java.lang.ClassLoader.loadLibrary0(Ljava/lang/Class;Ljava/io/File;)Z+300
  27. j java.lang.ClassLoader.loadLibrary(Ljava/lang/Class;Ljava/lang/String;Z)V+347
  28. j java.lang.Runtime.loadLibrary0(Ljava/lang/Class;Ljava/lang/String;)V+54
  29. j java.lang.System.loadLibrary(Ljava/lang/String;)V+7
  30. j org.apache.hadoop.util.NativeCodeLoader.<clinit>()V+25
  31. v ~StubRoutines::call_stub
  32. j org.apache.hadoop.io.nativeio.NativeIO.<clinit>()V+17
  33. v ~StubRoutines::call_stub
  34. j org.apache.hadoop.io.ReadaheadPool.getInstance()Lorg/apache/hadoop/io/ReadaheadPool;+12
  35. j org.apache.hadoop.mapred.TaskTracker.<init>(Lorg/apache/hadoop/mapred/JobConf;)V+145
  36. j org.apache.hadoop.mapred.TaskTracker.main([Ljava/lang/String;)V+52
  37. v ~StubRoutines::call_stub
  38. --------------- P R O C E S S ---------------
  39. Java Threads: ( => current thread )
  40. 0x0000002a972d1000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=7029, stack(0x000000004103a000,0x000000004113b000)]
  41. 0x0000002a972cf000 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=7028, stack(0x0000000040f39000,0x000000004103a000)]
  42. 0x0000002a972c9800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=7027, stack(0x0000000040e38000,0x0000000040f39000)]
  43. 0x0000002a972c7800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=7026, stack(0x0000000040d37000,0x0000000040e38000)]
  44. 0x0000002a972a6000 JavaThread "Finalizer" daemon [_thread_blocked, id=7025, stack(0x0000000040c36000,0x0000000040d37000)]
  45. 0x0000002a972a4000 JavaThread "Reference Handler" daemon [_thread_blocked, id=7024, stack(0x0000000040b35000,0x0000000040c36000)]
  46. =>0x0000000040122000 JavaThread "main" [_thread_in_native, id=7014, stack(0x000000004012b000,0x000000004022c000)]
  47. Other Threads:
  48. 0x0000002a9729d000 VMThread [stack: 0x0000000040a34000,0x0000000040b35000] [id=7023]
  49. 0x0000002a9b226800 WatcherThread [stack: 0x000000004113b000,0x000000004123c000] [id=7030]
  50. VM state:not at safepoint (normal execution)
  51. VM Mutex/Monitor currently owned by a thread: None
  52. Heap
  53. PSYoungGen total 150016K, used 18028K [0x00000000eb2b0000, 0x00000000f5a10000, 0x0000000100000000)
  54. eden space 128640K, 14% used [0x00000000eb2b0000,0x00000000ec44b318,0x00000000f3050000)
  55. from space 21376K, 0% used [0x00000000f4530000,0x00000000f4530000,0x00000000f5a10000)
  56. to space 21376K, 0% used [0x00000000f3050000,0x00000000f3050000,0x00000000f4530000)
  57. PSOldGen total 342848K, used 0K [0x00000000c1800000, 0x00000000d66d0000, 0x00000000eb2b0000)
  58. object space 342848K, 0% used [0x00000000c1800000,0x00000000c1800000,0x00000000d66d0000)
  59. PSPermGen total 21248K, used 9638K [0x00000000bc600000, 0x00000000bdac0000, 0x00000000c1800000)
  60. object space 21248K, 45% used [0x00000000bc600000,0x00000000bcf69910,0x00000000bdac0000)
  61. Code Cache [0x0000002a972e7000, 0x0000002a97557000, 0x0000002a9a2e7000)
  62. total_blobs=321 nmethods=82 adapters=193 free_code_cache=49720000 largest_free_block=21824

我不确定这个问题有没有人能帮我解决?我以同样的方式创造了奴隶。堆设置为1gb。非常感谢!

bbmckpt7

bbmckpt71#

您在本机代码中看到整数溢出或整数被零除( SIGFPE 引起 FPE_INTDIV .)
这条线索表明 -XX:-UseCompressedOops jvm启动标志可能会有所帮助。
此线程表明您的(linux)内核太旧:请尝试升级到新版本。

相关问题