从源代码编译和构建配置单元时出错

m1m5dgzv  于 2021-06-02  发布在  Hadoop
关注(0)|答案(0)|浏览(276)

我一直在尝试使用maven从源代码构建hive，但是当我从这里运行命令时仍然会遇到一些错误。我在主人身上编译Hive。我在网上搜索了将近一个星期，但没有找到解决问题的方法。
以下是每次尝试从主服务器上的源代码构建配置单元时遇到的错误：

  1. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.6.1:compile (default-compile) on project hive-serde: Compilation failure: Compilation failure:
  2. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ThriftJDBCBinarySerDe.java:[42,42] package org.apache.hive.service.rpc.thrift does not exist
  3. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[29,42] package org.apache.hive.service.rpc.thrift does not exist
  4. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[30,42] package org.apache.hive.service.rpc.thrift does not exist
  5. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[31,42] package org.apache.hive.service.rpc.thrift does not exist
  6. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[32,42] package org.apache.hive.service.rpc.thrift does not exist
  7. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[33,42] package org.apache.hive.service.rpc.thrift does not exist
  8. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[34,42] package org.apache.hive.service.rpc.thrift does not exist
  9. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[35,42] package org.apache.hive.service.rpc.thrift does not exist
  10. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[36,42] package org.apache.hive.service.rpc.thrift does not exist
  11. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[37,42] package org.apache.hive.service.rpc.thrift does not exist
  12. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[28,42] package org.apache.hive.service.rpc.thrift does not exist
  13. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[135,23] cannot find symbol
  14. [ERROR] symbol:   class TColumn
  15. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.ColumnBuffer
  16. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java:[315,10] cannot find symbol
  17. [ERROR] symbol:   class TColumn
  18. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.ColumnBuffer
  19. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[113,17] cannot find symbol
  20. [ERROR] symbol:   class TTypeId
  21. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.Type
  22. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[119,38] cannot find symbol
  23. [ERROR] symbol:   class TTypeId
  24. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.Type
  25. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[129,38] cannot find symbol
  26. [ERROR] symbol:   class TTypeId
  27. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.Type
  28. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[133,38] cannot find symbol
  29. [ERROR] symbol:   class TTypeId
  30. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.Type
  31. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[153,30] cannot find symbol
  32. [ERROR] symbol:   class TTypeId
  33. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.Type
  34. [ERROR] /home/elbasir/hive/serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java:[435,10] cannot find symbol
  35. [ERROR] symbol:   class TTypeId
  36. [ERROR] location: class org.apache.hadoop.hive.serde2.thrift.Type
  37. [ERROR] -> [Help 1]
  38. [ERROR] 
  39. [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
  40. [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  41. [ERROR] 
  42. [ERROR] For more information about the errors and possible solutions, please read the following articles:
  43. [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
  44. [ERROR] 
  45. [ERROR] After correcting the problems, you can resume the build with the command
  46. [ERROR]   mvn <goals> -rf :hive-serde

这是我的pom文件中的一些信息

  1. <groupId>org.apache.maven.plugins</groupId>
  2.       <artifactId>maven-compiler-plugin</artifactId>
  3.       <version>${maven.compiler.plugin.version}</version>
  4.     </plugin>
  5.     <plugin>
  6.       <groupId>org.apache.maven.plugins</groupId>
  7.       <artifactId>maven-antrun-plugin</artifactId>
  8.       <version>${maven.antrun.plugin.version}</version>
  9.       <dependencies>
  10.         <dependency>
  11.           <groupId>ant-contrib</groupId>
  12.           <artifactId>ant-contrib</artifactId>
  13.           <version>${ant.contrib.version}</version>
  14.           <exclusions>
  15.             <exclusion>
  16.               <groupId>ant</groupId>
  17.               <artifactId>ant</artifactId>
  18.             </exclusion>
  19.           </exclusions>
  20.         </dependency>
  21.       </dependencies>
  22.     </plugin>
  23.     <plugin>
  24.       <groupId>org.apache.maven.plugins</groupId>
  25.       <artifactId>maven-assembly-plugin</artifactId>
  26.       <version>${maven.assembly.plugin.version}</version>
  27.     </plugin>
  28.     <plugin>
  29.       <groupId>org.apache.maven.plugins</groupId>
  30.       <artifactId>maven-eclipse-plugin</artifactId>
  31.       <version>${maven.eclipse.plugin.version}</version>
  32.       <configuration>
  33.         <downloadJavadocs>true</downloadJavadocs>
  34.         <downloadSources>true</downloadSources>
  35.         <workspaceActiveCodeStyleProfileName>Hive</workspaceActiveCodeStyleProfileName>
  36.         <workspaceCodeStylesURL>${basedir}/dev-support/eclipse-styles.xml</workspaceCodeStylesURL>
  37.       </configuration>
  38.     </plugin>
  39.     <plugin>
  40.       <groupId>org.apache.maven.plugins</groupId>
  41.       <artifactId>maven-checkstyle-plugin</artifactId>
  42.       <version>${maven.checkstyle.plugin.version}</version>
  43.     </plugin>
  44.     <plugin>
  45.       <groupId>org.apache.maven.plugins</groupId>
  46.       <artifactId>maven-enforcer-plugin</artifactId>
  47.       <version>${maven.enforcer.plugin.version}</version>
  48.     </plugin>
  49.     <plugin>
  50.       <groupId>org.apache.maven.plugins</groupId>
  51.       <artifactId>maven-install-plugin</artifactId>
  52.       <version>${maven.install.plugin.version}</version>
  53.     </plugin>
  54.     <plugin>
  55.       <groupId>org.apache.maven.plugins</groupId>
  56.       <artifactId>maven-shade-plugin</artifactId>
  57.       <version>${maven.shade.plugin.version}</version>
  58.     </plugin>
  59.     <plugin>
  60.       <groupId>org.apache.maven.plugins</groupId>
  61.       <artifactId>maven-surefire-plugin</artifactId>
  62.       <version>2.18.1</version>
  63.     </plugin>
  64.     <plugin>
  65.       <groupId>org.apache.maven.plugins</groupId>
  66.       <artifactId>maven-jar-plugin</artifactId>
  67.       <version>${maven.jar.plugin.version}</version>
  68.       <configuration>
  69.         <archive>
  70.           <manifest>
  71.             <addDefaultImplementationEntries>true</addDefaultImplementationEntries>
  72.           </manifest>
  73.         </archive>
  74.       </configuration>
  75.     </plugin>
  76.     <plugin>
  77.       <groupId>org.apache.maven.plugins</groupId>
  78.       <artifactId>maven-war-plugin</artifactId>
  79.       <version>${maven.war.plugin.version}</version>
  80.     </plugin>
  81.     <plugin>
  82.       <groupId>org.datanucleus</groupId>
  83.       <artifactId>datanucleus-maven-plugin</artifactId>
  84.       <version>${datanucleus.maven.plugin.version}</version>
  85.       <dependencies>
  86.         <dependency>
  87.           <groupId>org.datanucleus</groupId>
  88.           <artifactId>datanucleus-core</artifactId>
  89.           <version>${datanucleus-core.version}</version>
  90.         </dependency>
  91.       </dependencies>
  92.     </plugin>
  93.     <plugin>
  94.       <groupId>org.apache.felix</groupId>
  95.       <artifactId>maven-bundle-plugin</artifactId>
  96.       <version>${felix.version}</version>
  97.     </plugin>
  98.     <plugin>
  99.       <groupId>org.apache.maven.plugins</groupId>
  100.       <artifactId>maven-dependency-plugin</artifactId>
  101.       <version>${maven.dependency.plugin.version}</version>
  102.     </plugin>
  103.     <plugin>
  104.       <groupId>org.codehaus.mojo</groupId>
  105.       <artifactId>build-helper-maven-plugin</artifactId>
  106.       <version>${maven.build-helper.plugin.version}</version>
  107.     </plugin>
  108.   </plugins>
  109. </pluginManagement>
  111. <plugins>
  112.   <!-- plugins are always listed in sorted order by groupId, artifectId -->
  113.   <plugin>
  114.     <groupId>org.apache.maven.plugins</groupId>
  115.     <artifactId>maven-antrun-plugin</artifactId>
  116.     <executions>
  117.       <execution>
  118.         <id>define-classpath</id>
  119.         <phase>process-resources</phase>
  120.         <goals>
  121.           <goal>run</goal>
  122.         </goals>
  123.         <configuration>
  124.           <exportAntProperties>true</exportAntProperties>
  125.           <target>
  126.             <property name="maven.test.classpath" refid="maven.test.classpath"/>
  127.           </target>
  128.         </configuration>
  129.       </execution>
  130.       <execution>
  131.         <id>setup-test-dirs</id>
  132.         <phase>process-test-resources</phase>
  133.         <goals>
  134.           <goal>run</goal>
  135.         </goals>
  136.         <configuration>
  137.           <target>
  138.             <delete dir="${test.tmp.dir}" />
  139.             <delete dir="${test.conf.dir}" />
  140.             <delete dir="${test.warehouse.dir}" />
  141.             <mkdir dir="${test.tmp.dir}" />
  142.             <mkdir dir="${test.warehouse.dir}" />
  143.             <mkdir dir="${test.conf.dir}" />
  144.             <!-- copies hive-site.xml so it can be modified -->
  145.             <copy todir="${test.conf.dir}">
  146.               <fileset dir="${basedir}/${hive.path.to.root}/data/conf/"/>
  147.             </copy>
  148.           </target>
  149.         </configuration>
  150.       </execution>
  151.     </executions>
  152.   </plugin>
  153.   <plugin>
  154.     <groupId>org.apache.maven.plugins</groupId>
  155.     <artifactId>maven-clean-plugin</artifactId>
  156.     <version>2.5</version>
  157.     <configuration>
  158.       <filesets>
  159.         <fileset>
  160.           <directory>./</directory>
  161.           <includes>
  162.             <include>datanucleus.log</include>
  163.             <include>derby.log</include>
  164.           </includes>
  165.           <followSymlinks>false</followSymlinks>
  166.         </fileset>
  167.         <fileset>
  168.           <directory>build</directory>
  169.           <followSymlinks>false</followSymlinks>
  170.         </fileset>
  171.       </filesets>
  172.     </configuration>
  173.   </plugin>
  174.   <plugin>
  175.     <groupId>org.apache.maven.plugins</groupId>
  176.     <artifactId>maven-checkstyle-plugin</artifactId>
  177.     <configuration>
  178.       <configLocation>${checkstyle.conf.dir}/checkstyle.xml</configLocation>
  179.       <propertyExpansion>basedir=${checkstyle.conf.dir}</propertyExpansion>
  180.     </configuration>
  181.   </plugin>
  182.   <plugin>
  183.     <groupId>org.apache.maven.plugins</groupId>
  184.     <artifactId>maven-enforcer-plugin</artifactId>
  185.     <executions>
  186.       <execution>
  187.         <id>enforce-no-snapshots</id>
  188.         <goals>
  189.           <goal>enforce</goal>
  190.         </goals>
  191.         <configuration>
  192.           <rules>
  193.             <requireReleaseDeps>
  194.               <message>Release builds are not allowed to have SNAPSHOT depenendencies</message>
  195.               <searchTransitive>true</searchTransitive>
  196.               <onlyWhenRelease>true</onlyWhenRelease>
  197.             </requireReleaseDeps>
  198.           </rules>
  199.           <fail>true</fail>
  200.         </configuration>
  201.       </execution>
  202.       <execution>
  203.         <id>enforce-banned-dependencies</id>
  204.         <goals>
  205.           <goal>enforce</goal>
  206.         </goals>
  207.         <configuration>
  208.           <rules>
  209.             <bannedDependencies>
  210.               <excludes>
  211.                 <!--LGPL licenced library-->
  212.                 <exclude>com.google.code.findbugs:annotations</exclude>
  213.               </excludes>
  214.             </bannedDependencies>
  215.           </rules>
  216.           <fail>true</fail>
  217.         </configuration>
  218.       </execution>
  219.     </executions>
  220.   </plugin>
  221.   <plugin>
  222.     <groupId>org.apache.maven.plugins</groupId>
  223.     <artifactId>maven-surefire-plugin</artifactId>
  224.     <configuration>
  225.       <excludes>
  226.         <exclude>**/TestSerDe.java</exclude>
  227.         <exclude>**/TestHiveMetaStore.java</exclude>
  228.         <exclude>**/ql/exec/vector/util/*.java</exclude>
  229.         <exclude>**/ql/exec/vector/udf/legacy/*.java</exclude>
  230.         <exclude>**/ql/exec/vector/udf/generic/*.java</exclude>
  231.         <exclude>**/TestHiveServer2Concurrency.java</exclude>
  232.         <exclude>${test.excludes.additional}</exclude>
  233.         <exclude>${skip.spark.files}</exclude>
  234.       </excludes>
  235.       <redirectTestOutputToFile>true</redirectTestOutputToFile>
  236.       <reuseForks>false</reuseForks>
  237.       <failIfNoTests>false</failIfNoTests>
  238.       <argLine>${maven.test.jvm.args}</argLine>
  239.       <trimStackTrace>false</trimStackTrace>
  240.       <additionalClasspathElements>
  241.         <additionalClasspathElement>${test.conf.dir}</additionalClasspathElement>
  242.         <additionalClasspathElement>${basedir}/${hive.path.to.root}/conf</additionalClasspathElement>
  243.       </additionalClasspathElements>
  244.       <environmentVariables>
  245.         <TZ>US/Pacific</TZ>
  246.         <LANG>en_US.UTF-8</LANG>
  247.         <HADOOP_CLASSPATH>${test.conf.dir}:${basedir}/${hive.path.to.root}/conf</HADOOP_CLASSPATH>
  248.         <HIVE_HADOOP_TEST_CLASSPATH>${test.hive.hadoop.classpath}</HIVE_HADOOP_TEST_CLASSPATH>
  249.         <SPARK_SUBMIT_CLASSPATH>${spark.home}/lib/spark-assembly-${spark.version}-hadoop2.4.0.jar:${test.hive.hadoop.classpath}</SPARK_SUBMIT_CLASSPATH>
  250.         <SPARK_OSX_TEST_OPTS>-Dorg.xerial.snappy.tempdir=/tmp -Dorg.xerial.snappy.lib.name=libsnappyjava.jnilib</SPARK_OSX_TEST_OPTS>
  251.         <PATH>${env.PATH}${test.extra.path}</PATH>
  252.       </environmentVariables>
  253.       <systemPropertyVariables>
  254.         <build.dir>${project.build.directory}</build.dir>
  255.         <!-- required by zk test ClientBase -->
  256.         <build.test.dir>${test.tmp.dir}</build.test.dir>
  257.         <!-- required by a few tests to find the derby jar -->
  258.         <derby.version>${derby.version}</derby.version>
  259.         <derby.stream.error.file>${test.tmp.dir}/derby.log</derby.stream.error.file>
  260.         <hadoop.bin.path>${hadoop.bin.path}</hadoop.bin.path>
  261.         <!-- required by Hadoop's JobHistory -->
  262.         <hadoop.log.dir>${test.tmp.dir}</hadoop.log.dir>
  263.         <hive.root>${basedir}/${hive.path.to.root}/</hive.root>
  264.         <hive.version>${project.version}</hive.version>
  265.         <!-- required for hive-exec jar path and tests which reference a jar -->
  266.         <maven.local.repository>${maven.repo.local}</maven.local.repository>
  267.         <mapred.job.tracker>local</mapred.job.tracker>
  268.         <log4j.configurationFile>${test.log4j.scheme}${test.conf.dir}/hive-log4j2.properties</log4j.configurationFile>
  269.         <hive.test.console.log.level>${test.console.log.level}</hive.test.console.log.level>
  270.         <log4j.debug>true</log4j.debug>
  271.         <!-- don't diry up /tmp -->
  272.         <java.io.tmpdir>${test.tmp.dir}</java.io.tmpdir>
  273.         <spark.home>${spark.home}</spark.home>
  274.         <!-- Hadoop's minidfs class uses this -->
  275.         <test.build.data>${test.tmp.dir}</test.build.data>
  276.         <!-- required by QTestUtil -->
  277.         <test.data.files>${basedir}/${hive.path.to.root}/data/files</test.data.files>
  278.         <test.data.dir>${basedir}/${hive.path.to.root}/data/files</test.data.dir>
  279.         <test.tmp.dir>${test.tmp.dir}</test.tmp.dir>
  280.         <test.tmp.dir.uri>${test.tmp.dir.uri}</test.tmp.dir.uri>
  281.         <test.dfs.mkdir>${test.dfs.mkdir}</test.dfs.mkdir>
  282.         <test.output.overwrite>${test.output.overwrite}</test.output.overwrite>
  283.         <test.warehouse.dir>${test.warehouse.scheme}${test.warehouse.dir}</test.warehouse.dir>
  284.         <java.net.preferIPv4Stack>true</java.net.preferIPv4Stack>
  285.         <!-- EnforceReadOnlyTables hook and QTestUtil -->
  286.         <test.src.tables>src,src1,srcbucket,srcbucket2,src_json,src_thrift,src_sequencefile,srcpart,alltypesorc,src_hbase,cbo_t1,cbo_t2,cbo_t3,src_cbo,part,lineitem</test.src.tables>
  287.         <java.security.krb5.conf>${test.conf.dir}/krb5.conf</java.security.krb5.conf>
  288.         <!-- Required by spark to work around SPARK-14958 -->
  289.         <antlr.version>${antlr.version}</antlr.version>
  290.         <qfile>${qfile}</qfile>
  291.         <initScript>${initScript}</initScript>
  292.         <clustermode>${clustermode}</clustermode>
  293.         <qfile_regex>${qfile_regex}</qfile_regex>
  294.         <run_disabled>${run_disabled}</run_disabled>
  295.       </systemPropertyVariables>
  296.     </configuration>
  297.   </plugin>
JavahadoopMavenHiveeclipse

暂无答案！

目前还没有任何答案，快来回答吧！

我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com