Oozie4.2.0使用Java1.8的Hadoop2.7生成错误

muk1a3rh  于 2021-05-29  发布在  Hadoop
关注(0)|答案(3)|浏览(645)

我在伪hadoop模式下运行。包含以下组件-hadoop v2.7.0-java 1.8+-oozie 4.2.0-os-fedora 22 vm-maven 3.3
我对java或maven一无所知，我对用maven构建这个世界是完全陌生的。我在探索oozie并想构建它，但每次尝试构建它时，它都会失败，并出现以下错误。我有搜索博客和已知的博客（人们提到过gauravkohli博客，但这对我也没有帮助）没有太多帮助。有人能帮帮我吗？
第二，虽然我关注了一些博客，他们提到只有hadoop版本需要更改，但即使如此，我认为我需要更改hbase和其他组件版本，因为它们的版本比ooze发行版中提到的版本要高得多，如果对这方面的任何输入也会有很大的见解的话。

[INFO]-------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] Apache Oozie Main ..............................SUCCESS [  1.995 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS [ 15.697 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS [  1.059 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS [  0.357 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS [  0.080 s]
[INFO] Apache Oozie Client ............................SUCCESS [ 10.525 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS [  8.120 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS [  4.637 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS [  1.528 s]
[INFO] Apache Oozie Core ..............................FAILURE [  5.388 s]
[INFO] Apache Oozie Share Lib Streaming ...................SKIPPED
[INFO] Apache Oozie Share Lib Pig .........................SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ......................SKIPPED
[INFO] Apache Oozie Share Lib Sqoop .......................SKIPPED
[INFO] Apache Oozie Examples ..............................SKIPPED
[INFO] Apache Oozie Share Lib Spark .......................SKIPPED
[INFO] Apache Oozie Share Lib .............................SKIPPED
[INFO] Apache Oozie Docs ..................................SKIPPED
[INFO] Apache Oozie WebApp ............................... SKIPPED
[INFO] Apache Oozie Tools ................................ SKIPPED
[INFO] Apache Oozie MiniOozie .............................SKIPPED
[INFO] Apache Oozie Distro ................................SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests ..............SKIPPED
[INFO]------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]-------------------------------------------------------------
[INFO] Total time: 51.047 s
[INFO] Finished at: 2015-10-11T12:44:19+11:00
[INFO] Final Memory: 96M/230M
[INFO]-------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-remote-resources-plugin:1.5:process (default) on project 
oozie-core: Error resolving project artifact: Could not transfer artifact 
org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to 
Codehaus repository (http://repository.codehaus.org/): 
repository.codehaus.org: unknown error for project org.pentaho:pentaho-
aggdesigner-algorithm:jar:5.1.5-jhyde: Unknown host 
repository.codehaus.org: unknown error -> [Help 1] 
[ERROR]To see the full stack trace of the errors, re-run Maven-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions, 
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/disp
[ERROR] After correcting the problems, you can resume the build with the 
command
[ERROR]   mvn <goals> -rf :oozie-core

                  **[edit]Edited: Vishant : 12-Oct-2015**

After doing some research and editing the pom.xml file. I enadbled the 
REPO1 and  Cloudera repositories, but then I stumbled upon the below 
error. I went ahead and checked the REPO1 repository

**DOES NOT have hbase 1.1.2 jars.**

[INFO] ----------------------------------------------------------------
[INFO] Building Apache Oozie Core 4.2.0
[INFO]-----------------------------------------------------------------
[INFO] ----------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Oozie Main ..............................SUCCESS[2.334 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS[4.010 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS[0.341 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS[0.688 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS[0.066 s]
[INFO] Apache Oozie Client ............................SUCCESS[10.832 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS[4.394 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS[5.641 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS[1.550 s]
[INFO] Apache Oozie Core ..............................FAILURE[0.508 s]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] -------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] -------------------------------------------------------------
[INFO] Total time: 32.115 s
[INFO] Finished at: 2015-10-12T11:03:04+11:00
[INFO] Final Memory: 100M/239M
[INFO] -------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-core: Could not resolve 
dependencies for project org.apache.oozie:oozie-core:jar:4.2.0: Failure 
to find org.apache.hbase:hbase:jar:1.1.2 in http://repo1.maven.org/maven2 
was cached in the local repository, resolution will not be reattempted 
until the update interval of central has elapsed or updates are forced 
->[Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with 
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, 
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN
/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the 
command
[ERROR]   mvn <goals> -rf :oozie-core

我该如何继续？如何将jar添加到本地存储库并继续？

hadoopMavenoozie

3条答案

按热度按时间
xmq68pz9

xmq68pz91#

我很抱歉，因为我以前没有特权回答我自己的问题！！
回答：
我已经解决了这个错误。遵循以下步骤，但是codehaus的东西根本不起作用
第一步。下载jar文件hbase jar
第二步。编辑pom.xml以指向jar文件，

<dependency>  
        <groupID>org.apache.hbase</groupID>  
        <artifactID>hbase</artifactID>  
        <version>${hbase.version}</version>  
        <scope>system</scope>  
        <system>system/path/to/jar/file/myjar.jar</system>  
    </dependency>

第三步。将hbase文件添加到maven存储库

mvn install:install-file -Dfile=<path-to-file> -DgroupId=<group-id> \ -DartifactId=<artifact-id> -Dversion=<version> -Dpackaging=<packaging>

编辑日期：2016年1月13日我添加了hbase-common-1.1.2.jar文件，因为我的hbase版本是1.1.2。请根据您的hbase版本添加hbase公共文件。

赞(0）分享  回复(0）举报  2021-05-30
sq1bmfud

sq1bmfud2#

我解决了pom.xml的所有问题，如下链接oozie-4.2pom.xml
您可以看到我更改了一些配置，包括更改codehasrespositoryurl和其他一些配置。

<groupId>org.apache.hadoop</groupId>
     <artifactId>hadoop-tools</artifactId>
            <version>1.2.1</version>
<!--<version>${distcp.version}</version>-->

<groupId>org.apache.hadoop</groupId>
     <artifactId>hadoop-core</artifactId>
            <version>1.2.1</version>
<!--<version>${hadoop.auth.version}</version>-->

您可以尝试使用pom.xml来创建。

赞(0）分享  回复(0）举报  2021-05-30
dw1jzc5e

dw1jzc5e3#

这是因为codehaus.org不再托管maven回购。你可以在https://www.codehaus.org/mechanics/maven/
在pom.xml中，将codehaus存储库的url更改为->https://repository-master.mulesoft.org/nexus/content/groups/public/ <repository> <id>Codehaus repository</id> <url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url> <snapshots> <enabled>false</enabled> </snapshots> </repository>

赞(0）分享  回复(0）举报  2021-05-30
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com