未能执行goal org.apache.mavenplugins:maven-antrun-plugin:1.6:在项目hadoop上运行(预分布)项目分布:

i5desfxk  于 2021-06-03  发布在  Hadoop
关注(0)|答案(4)|浏览(421)

我需要帮助,因为我正试图从过去的2-3天解决这个问题。。
我正在windows-7(64位)机器上安装hadoop。这是为了尝试r与hadoop的集成。
我遵循了url中给出的hadoop安装说明-http://www.srccodes.com/p/article/38/build-install-configure-run-apache-hadoop-2.2.0-microsoft-windows-os
环境变量如下:jave\u home:c:\program files\java\jdk1.6.0\u 45 m2\u home:c:\hadoop\apache-maven-3.1.1路径:c:\cygwin64\bin;c:\hadoop\apache-maven-3.1.1\bin;c:\hadoop\协议-2.5.0-win32
mvn包-pdist,本机win-dskiptests-dtar
我在WindowsSDK7.1命令提示符下运行了上面的命令,得到下面的错误。。。非常感谢您的早期帮助。。

  1. ****************************************************************************************
  2. [INFO] ------------------------------------------------------------------------
  3. [INFO] Reactor Summary:
  4. [INFO]
  5. [INFO] Apache Hadoop Main ................................ SUCCESS [8.893s]
  6. [INFO] Apache Hadoop Project POM ......................... SUCCESS [4.782s]
  7. [INFO] Apache Hadoop Annotations ......................... SUCCESS [9.500s]
  8. [INFO] Apache Hadoop Assemblies .......................... SUCCESS [2.145s]
  9. [INFO] Apache Hadoop Project Dist POM .................... FAILURE [4.141s]
  10. [INFO] Apache Hadoop Maven Plugins ....................... SKIPPED
  11. [INFO] Apache Hadoop Auth ................................ SKIPPED
  12. [INFO] Apache Hadoop Auth Examples ....................... SKIPPED
  13. [INFO] Apache Hadoop Common .............................. SKIPPED
  14. [INFO] Apache Hadoop NFS ................................. SKIPPED
  15. [INFO] Apache Hadoop Common Project ...................... SKIPPED
  16. [INFO] Apache Hadoop HDFS ................................ SKIPPED
  17. [INFO] Apache Hadoop HttpFS .............................. SKIPPED
  18. [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
  19. [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
  20. [INFO] Apache Hadoop HDFS Project ........................ SKIPPED
  21. [INFO] hadoop-yarn ....................................... SKIPPED
  22. [INFO] hadoop-yarn-api ................................... SKIPPED
  23. [INFO] hadoop-yarn-common ................................ SKIPPED
  24. [INFO] hadoop-yarn-server ................................ SKIPPED
  25. [INFO] hadoop-yarn-server-common ......................... SKIPPED
  26. [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
  27. [INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED
  28. [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
  29. [INFO] hadoop-yarn-server-tests .......................... SKIPPED
  30. [INFO] hadoop-yarn-client ................................ SKIPPED
  31. [INFO] hadoop-yarn-applications .......................... SKIPPED
  32. [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
  33. [INFO] hadoop-mapreduce-client ........................... SKIPPED
  34. [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
  35. [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED
  36. [INFO] hadoop-yarn-site .................................. SKIPPED
  37. [INFO] hadoop-yarn-project ............................... SKIPPED
  38. [INFO] hadoop-mapreduce-client-common .................... SKIPPED
  39. [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
  40. [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
  41. [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
  42. [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
  43. [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
  44. [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
  45. [INFO] hadoop-mapreduce .................................. SKIPPED
  46. [INFO] Apache Hadoop MapReduce Streaming ................. SKIPPED
  47. [INFO] Apache Hadoop Distributed Copy .................... SKIPPED
  48. [INFO] Apache Hadoop Archives ............................ SKIPPED
  49. [INFO] Apache Hadoop Rumen ............................... SKIPPED
  50. [INFO] Apache Hadoop Gridmix ............................. SKIPPED
  51. [INFO] Apache Hadoop Data Join ........................... SKIPPED
  52. [INFO] Apache Hadoop Extras .............................. SKIPPED
  53. [INFO] Apache Hadoop Pipes ............................... SKIPPED
  54. [INFO] Apache Hadoop Tools Dist .......................... SKIPPED
  55. [INFO] Apache Hadoop Tools ............................... SKIPPED
  56. [INFO] Apache Hadoop Distribution ........................ SKIPPED
  57. [INFO] Apache Hadoop Client .............................. SKIPPED
  58. [INFO] Apache Hadoop Mini-Cluster ........................ SKIPPED
  59. [INFO] ------------------------------------------------------------------------
  60. [INFO] BUILD FAILURE
  61. [INFO] ------------------------------------------------------------------------
  62. [INFO] Total time: 32.981s
  63. [INFO] Finished at: Thu Feb 13 14:06:51 IST 2014
  64. [INFO] Final Memory: 32M/190M
  65. [INFO] ------------------------------------------------------------------------
  66. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (pre-dist) on project hadoop-project-dist: An Ant BuildException has occured : exec returned: 2 -> [Help 1]
  67. org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (pre-dist) on project hadoop-project-dist: An Ant BuildException has occured: exec returned: 2
  68. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
  69. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
  70. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
  71. at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
  72. at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
  73. at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
  74. at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
  75. at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317)
  76. at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152)
  77. at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
  78. at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
  79. at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
  80. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  81. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
  82. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  83. at java.lang.reflect.Method.invoke(Method.java:597)
  84. at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
  85. at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
  86. at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
  87. at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
  88. Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildException
  89. has occured: exec returned: 2
  90. at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283)
  91. at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106)
  92. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
  93. ... 19 more
  94. Caused by: C:\Hadoop\hdfs\hadoop-project-dist\target\antrun\build-main.xml:31: exec returned: 2
  95. at org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:650)
  96. at org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:676)
  97. at org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:502)
  98. at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
  99. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  100. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
  101. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  102. at java.lang.reflect.Method.invoke(Method.java:597)
  103. at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
  104. at org.apache.tools.ant.Task.perform(Task.java:348)
  105. at org.apache.tools.ant.Target.execute(Target.java:390)
  106. at org.apache.tools.ant.Target.performTasks(Target.java:411)
  107. at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
  108. at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
  109. at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270)
  110. ... 21 more
  111. [ERROR]
  112. [ERROR]
  113. [ERROR] For more information about the errors and possible solutions, please read the following articles:
  114. [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
  115. [ERROR]
  116. [ERROR] After correcting the problems, you can resume the build with the command
  117. [ERROR] mvn <goals> -rf :hadoop-project-dist

提前谢谢gopal

prdp8dxp

prdp8dxp1#

我使用下面的命令,它成功了。

  1. mvn clean package -DskipTests -Dtar
kq4fsx7k

kq4fsx7k2#

“mvn package-pdist,native win-dskiptests-dtar”根据这个命令,您试图编译和打包“native libraries”(native win关键字),而要做到这一点,给定链接中给出的任何包都是不够的。
要解决这个问题,有两种选择:
1) 不需要本机库,hadoop将使用“内置java类”而不是本机库。使用以下命令:“mvn package-pdist-dskiptests-dtar”而不是您的命令
2) 如果您想使用本机库,请遵循本机库指南。这里给出了构建本机库所需的所有包和其他重要信息。
我的建议是使用第一个选项,因为我在某个地方读到,在windows上构建本机库有很多问题,在windows上不是首选。
阅读hadoop src文件夹中的“building.txt”,它可以帮助您使用各种命令进行打包。
以上可能是解决你问题的方法。试试看

xdyibdwo

xdyibdwo3#

我也犯了同样的错误。当我用-x运行mvn package-pdist、native win-dskiptests-dtar时,maven告诉我执行dist-copynativelibs.sh脚本有一些问题。
问题是windows命令提示符不能运行sh命令,只能运行bash命令。不知道为什么-cygwin安装正确并添加到路径。因此,我将pom文件d:\hdfs\hadoop project dist\pom.xml中的executable=“sh”更改为executable=“bash”:

  1. <exec executable="bash" dir="${project.build.directory}" failonerror="true">
  2. <arg line="./dist-copynativelibs.sh"/>
  3. </exec>

建造成功了。

irlmq6kh

irlmq6kh4#

你解决问题了吗?我在安装hadoop时遇到了类似的问题。我发现构建源文件阶段的所有问题都与路径变量设置有关。
1确保安装了jdk,而不是只有jre可用
2如果您遵循此链接上的说明,则需要一个附加路径设置:http://www.srccodes.com/p/article/38/build-install-configure-run-apache-hadoop-2.2.0-microsoft-windows-os :将.net msbuild.exe主目录添加到路径,它应类似于c:\windows\microsoft.net\framework64\v4.030319
三。检查所有路径值是否正确。在我的安装过程中,我遇到了一个与cygwin path有关的问题,cygwin安装在名为cygwin64的文件夹中,但一开始我只是将cygwin添加为path值,这花了我一些时间来解决。

相关问题