Oozie4.2.0使用Java1.8的Hadoop2.7生成错误

muk1a3rh  于 2021-05-29  发布在  Hadoop
关注(0)|答案(3)|浏览(733)

我在伪hadoop模式下运行。包含以下组件-hadoop v2.7.0-java 1.8+-oozie 4.2.0-os-fedora 22 vm-maven 3.3
我对java或maven一无所知，我对用maven构建这个世界是完全陌生的。我在探索oozie并想构建它，但每次尝试构建它时，它都会失败，并出现以下错误。我有搜索博客和已知的博客（人们提到过gauravkohli博客，但这对我也没有帮助）没有太多帮助。有人能帮帮我吗？
第二，虽然我关注了一些博客，他们提到只有hadoop版本需要更改，但即使如此，我认为我需要更改hbase和其他组件版本，因为它们的版本比ooze发行版中提到的版本要高得多，如果对这方面的任何输入也会有很大的见解的话。

  1. [INFO]-------------------------------------------------------------
  2. [INFO] Reactor Summary:
  3. [INFO] Apache Oozie Main ..............................SUCCESS [  1.995 s]
  4. [INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS [ 15.697 s]
  5. [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS [  1.059 s]
  6. [INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS [  0.357 s]
  7. [INFO] Apache Oozie Hadoop Libs .......................SUCCESS [  0.080 s]
  8. [INFO] Apache Oozie Client ............................SUCCESS [ 10.525 s]
  9. [INFO] Apache Oozie Share Lib Oozie ...................SUCCESS [  8.120 s]
  10. [INFO] Apache Oozie Share Lib HCatalog ................SUCCESS [  4.637 s]
  11. [INFO] Apache Oozie Share Lib Distcp ..................SUCCESS [  1.528 s]
  12. [INFO] Apache Oozie Core ..............................FAILURE [  5.388 s]
  13. [INFO] Apache Oozie Share Lib Streaming ...................SKIPPED
  14. [INFO] Apache Oozie Share Lib Pig .........................SKIPPED
  15. [INFO] Apache Oozie Share Lib Hive ........................SKIPPED
  16. [INFO] Apache Oozie Share Lib Hive 2 ......................SKIPPED
  17. [INFO] Apache Oozie Share Lib Sqoop .......................SKIPPED
  18. [INFO] Apache Oozie Examples ..............................SKIPPED
  19. [INFO] Apache Oozie Share Lib Spark .......................SKIPPED
  20. [INFO] Apache Oozie Share Lib .............................SKIPPED
  21. [INFO] Apache Oozie Docs ..................................SKIPPED
  22. [INFO] Apache Oozie WebApp ............................... SKIPPED
  23. [INFO] Apache Oozie Tools ................................ SKIPPED
  24. [INFO] Apache Oozie MiniOozie .............................SKIPPED
  25. [INFO] Apache Oozie Distro ................................SKIPPED
  26. [INFO] Apache Oozie ZooKeeper Security Tests ..............SKIPPED
  27. [INFO]------------------------------------------------------------
  28. [INFO] BUILD FAILURE
  29. [INFO]-------------------------------------------------------------
  30. [INFO] Total time: 51.047 s
  31. [INFO] Finished at: 2015-10-11T12:44:19+11:00
  32. [INFO] Final Memory: 96M/230M
  33. [INFO]-------------------------------------------------------------
  34. [ERROR] Failed to execute goal org.apache.maven.plugins:
  35. maven-remote-resources-plugin:1.5:process (default) on project 
  36. oozie-core: Error resolving project artifact: Could not transfer artifact 
  37. org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to 
  38. Codehaus repository (http://repository.codehaus.org/): 
  39. repository.codehaus.org: unknown error for project org.pentaho:pentaho-
  40. aggdesigner-algorithm:jar:5.1.5-jhyde: Unknown host 
  41. repository.codehaus.org: unknown error -> [Help 1] 
  42. [ERROR]To see the full stack trace of the errors, re-run Maven-e switch.
  43. [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  44. [ERROR] For more information about the errors and possible solutions, 
  45. please read the following articles:
  46. [ERROR] [Help 1] http://cwiki.apache.org/confluence/disp
  47. [ERROR] After correcting the problems, you can resume the build with the 
  48. command
  49. [ERROR]   mvn <goals> -rf :oozie-core
  51.                   **[edit]Edited: Vishant : 12-Oct-2015**
  53. After doing some research and editing the pom.xml file. I enadbled the 
  54. REPO1 and  Cloudera repositories, but then I stumbled upon the below 
  55. error. I went ahead and checked the REPO1 repository
  57. **DOES NOT have hbase 1.1.2 jars.**
  59. [INFO] ----------------------------------------------------------------
  60. [INFO] Building Apache Oozie Core 4.2.0
  61. [INFO]-----------------------------------------------------------------
  62. [INFO] ----------------------------------------------------------------
  63. [INFO] Reactor Summary:
  64. [INFO] 
  65. [INFO] Apache Oozie Main ..............................SUCCESS[2.334 s]
  66. [INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS[4.010 s]
  67. [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS[0.341 s]
  68. [INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS[0.688 s]
  69. [INFO] Apache Oozie Hadoop Libs .......................SUCCESS[0.066 s]
  70. [INFO] Apache Oozie Client ............................SUCCESS[10.832 s]
  71. [INFO] Apache Oozie Share Lib Oozie ...................SUCCESS[4.394 s]
  72. [INFO] Apache Oozie Share Lib HCatalog ................SUCCESS[5.641 s]
  73. [INFO] Apache Oozie Share Lib Distcp ..................SUCCESS[1.550 s]
  74. [INFO] Apache Oozie Core ..............................FAILURE[0.508 s]
  75. [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
  76. [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
  77. [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
  78. [INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
  79. [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
  80. [INFO] Apache Oozie Examples .............................. SKIPPED
  81. [INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
  82. [INFO] Apache Oozie Share Lib ............................. SKIPPED
  83. [INFO] Apache Oozie Docs .................................. SKIPPED
  84. [INFO] Apache Oozie WebApp ................................ SKIPPED
  85. [INFO] Apache Oozie Tools ................................. SKIPPED
  86. [INFO] Apache Oozie MiniOozie ............................. SKIPPED
  87. [INFO] Apache Oozie Distro ................................ SKIPPED
  88. [INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
  89. [INFO] -------------------------------------------------------------
  90. [INFO] BUILD FAILURE
  91. [INFO] -------------------------------------------------------------
  92. [INFO] Total time: 32.115 s
  93. [INFO] Finished at: 2015-10-12T11:03:04+11:00
  94. [INFO] Final Memory: 100M/239M
  95. [INFO] -------------------------------------------------------------
  96. [ERROR] Failed to execute goal on project oozie-core: Could not resolve 
  97. dependencies for project org.apache.oozie:oozie-core:jar:4.2.0: Failure 
  98. to find org.apache.hbase:hbase:jar:1.1.2 in http://repo1.maven.org/maven2 
  99. was cached in the local repository, resolution will not be reattempted 
  100. until the update interval of central has elapsed or updates are forced 
  101. ->[Help 1]
  102. [ERROR] 
  103. [ERROR] To see the full stack trace of the errors, re-run Maven with 
  104. the -e switch.
  105. [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  106. [ERROR] 
  107. [ERROR] For more information about the errors and possible solutions, 
  108. please read the following articles:
  109. [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN
  110. /DependencyResolutionException
  111. [ERROR] 
  112. [ERROR] After correcting the problems, you can resume the build with the 
  113. command
  114. [ERROR]   mvn <goals> -rf :oozie-core

我该如何继续？如何将jar添加到本地存储库并继续？

hadoopMavenoozie

3条答案

按热度按时间
xmq68pz9

xmq68pz91#

我很抱歉，因为我以前没有特权回答我自己的问题！！
回答：
我已经解决了这个错误。遵循以下步骤，但是codehaus的东西根本不起作用
第一步。下载jar文件hbase jar
第二步。编辑pom.xml以指向jar文件，

  1. <dependency>  
  2.         <groupID>org.apache.hbase</groupID>  
  3.         <artifactID>hbase</artifactID>  
  4.         <version>${hbase.version}</version>  
  5.         <scope>system</scope>  
  6.         <system>system/path/to/jar/file/myjar.jar</system>  
  7.     </dependency>

第三步。将hbase文件添加到maven存储库

  1. mvn install:install-file -Dfile=<path-to-file> -DgroupId=<group-id> \ -DartifactId=<artifact-id> -Dversion=<version> -Dpackaging=<packaging>

编辑日期：2016年1月13日我添加了hbase-common-1.1.2.jar文件，因为我的hbase版本是1.1.2。请根据您的hbase版本添加hbase公共文件。

展开查看全部
赞(0）分享  回复(0）举报  2021-05-30
sq1bmfud

sq1bmfud2#

我解决了pom.xml的所有问题，如下链接oozie-4.2pom.xml
您可以看到我更改了一些配置，包括更改codehasrespositoryurl和其他一些配置。

  1. <groupId>org.apache.hadoop</groupId>
  2.      <artifactId>hadoop-tools</artifactId>
  3.             <version>1.2.1</version>
  4. <!--<version>${distcp.version}</version>-->
  6. <groupId>org.apache.hadoop</groupId>
  7.      <artifactId>hadoop-core</artifactId>
  8.             <version>1.2.1</version>
  9. <!--<version>${hadoop.auth.version}</version>-->

您可以尝试使用pom.xml来创建。

赞(0）分享  回复(0）举报  2021-05-30
dw1jzc5e

dw1jzc5e3#

这是因为codehaus.org不再托管maven回购。你可以在https://www.codehaus.org/mechanics/maven/
在pom.xml中，将codehaus存储库的url更改为->https://repository-master.mulesoft.org/nexus/content/groups/public/ <repository> <id>Codehaus repository</id> <url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url> <snapshots> <enabled>false</enabled> </snapshots> </repository>

赞(0）分享  回复(0）举报  2021-05-30
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com