生成parquet mr时发生未报告的异常

jtoj6r0c  于 2021-07-08  发布在  Java
关注(0)|答案(0)|浏览(256)

我想用mrhttps://github.com/apache/parquet-mr.git
运行时遇到以下异常 mvn clean install . 我已经安装了 Thrift 在Windows上。
通过观察异常,它给出了一个明确的信息 try/catch block 或者 throws signature 不见了。但这是apache从主分支获取的代码,没有做任何更改。

OS - Windows 10
Thrift - 0.13.0
Java - openjdk version "1.8.0_242"
Maven - 3.6.3

"C:\Program Files\AdoptOpenJDK\jdk-8-hotspot\bin\java.exe" "-Dmaven.multiModuleProjectDirectory=D:\parquet-mr" "-Dmaven.home=C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\plugins\maven\lib\maven3" "-Dclassworlds.conf=C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\plugins\maven\lib\maven3\bin\m2.conf" "-Dmaven.ext.class.path=C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\plugins\maven\lib\maven-event-listener.jar" "-javaagent:C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\lib\idea_rt.jar=64441:C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\plugins\maven\lib\maven3\boot\plexus-classworlds-2.6.0.jar;C:\Program Files\JetBrains\IntelliJ IDEA 2020.2.3\plugins\maven\lib\maven3\boot\plexus-classworlds.license" org.codehaus.classworlds.Launcher -Didea.version=2020.2.3 clean install
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.parquet:parquet-scala_2.12:jar:1.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.parquet:parquet-scala_${scala.binary.version}:1.12.0-SNAPSHOT, D:\parquet-mr\parquet-scala\pom.xml, line 29, column 15
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ org.apache.parquet:parquet-scala_${scala.binary.version}:1.12.0-SNAPSHOT, D:\parquet-mr\parquet-scala\pom.xml, line 77, column 15
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.apache.parquet:parquet-scrooge_2.12:jar:1.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.parquet:parquet-scrooge_${scala.binary.version}:1.12.0-SNAPSHOT, D:\parquet-mr\parquet-scrooge\pom.xml, line 29, column 15
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] Apache Parquet MR                                                  [pom]
[INFO] Apache Parquet Format Structures                                   [jar]
[INFO] Apache Parquet Generator                                           [jar]
[INFO] Apache Parquet Common                                              [jar]
[INFO] Apache Parquet Encodings                                           [jar]
[INFO] Apache Parquet Column                                              [jar]
[INFO] Apache Parquet Arrow                                               [jar]
[INFO] Apache Parquet Jackson                                             [jar]
[INFO] Apache Parquet Hadoop                                              [jar]
[INFO] Apache Parquet Avro                                                [jar]
[INFO] Apache Parquet Benchmarks                                          [jar]
[INFO] Apache Parquet Pig                                                 [jar]
[INFO] Apache Parquet Thrift                                              [jar]
[INFO] Apache Parquet Cascading                                           [jar]
[INFO] Apache Parquet Cascading (for Cascading 3.0 onwards)               [jar]
[INFO] Apache Parquet Command-line                                        [jar]
[INFO] Apache Parquet Pig Bundle                                          [jar]
[INFO] Apache Parquet Protobuf                                            [jar]
[INFO] Apache Parquet Scala                                               [jar]
[INFO] Apache Parquet Scrooge                                             [jar]
[INFO] Apache Parquet Hadoop Bundle                                       [jar]
[INFO] Apache Parquet Hive                                                [pom]
[INFO] Apache Parquet Hive Binding Parent                                 [pom]
[INFO] Apache Parquet Hive Binding Interface                              [jar]
[INFO] Apache Parquet Hive 0.10 Binding                                   [jar]
[INFO] Apache Parquet Hive 0.12 Binding                                   [jar]
[INFO] Apache Parquet Hive Binding Factory                                [jar]
[INFO] Apache Parquet Hive Binding Bundle                                 [jar]
[INFO] Apache Parquet Hive Storage Handler                                [jar]
[INFO] Apache Parquet Hive Bundle                                         [jar]
[INFO] Apache Parquet Tools                                               [jar]
[INFO] 
[INFO] ---------------------< org.apache.parquet:parquet >---------------------
[INFO] Building Apache Parquet MR 1.12.0-SNAPSHOT                        [1/31]
[INFO] --------------------------------[ pom ]---------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ parquet ---
[INFO] Deleting D:\parquet-mr\target
[INFO] 
[INFO] --- buildnumber-maven-plugin:1.1:create (default) @ parquet ---
[INFO] Checking for local modifications: skipped.
[INFO] Updating project files from SCM: skipped.
[INFO] Executing: cmd.exe /X /C "git rev-parse --verify HEAD"
[INFO] Working directory: D:\parquet-mr
[INFO] Storing buildNumber: 5c6916c23cb2b9c225ea80328550ee0e11aee225 at timestamp: 1606499719604
[INFO] Executing: cmd.exe /X /C "git rev-parse --verify HEAD"
[INFO] Working directory: D:\parquet-mr
[INFO] Storing buildScmBranch: UNKNOWN
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ parquet ---
[INFO] 
[INFO] --- apache-rat-plugin:0.12:check (default) @ parquet ---
[INFO] Enabled default license matchers.
[INFO] Will parse SCM ignores for exclusions...
[INFO] Parsing exclusions from D:\parquet-mr\.gitignore
[INFO] Finished adding exclusions from SCM ignore files.
[INFO] 99 implicit excludes (use -debug for more details).
[INFO] Exclude: .github/PULL_REQUEST_TEMPLATE.md
[INFO] Exclude:**/*.parquet
[INFO] Exclude:**/*.avro
[INFO] Exclude:**/*.json
[INFO] Exclude:**/names.txt
[INFO] Exclude:**/*.avsc
[INFO] Exclude:**/*.iml
[INFO] Exclude:**/*.log
[INFO] Exclude:**/*.md.vm
[INFO] Exclude:**/.classpath
[INFO] Exclude:**/.project
[INFO] Exclude:**/.settings/**
[INFO] Exclude:**/build/**
[INFO] Exclude:**/target/**
[INFO] Exclude: .git/**
[INFO] Exclude: .gitignore
[INFO] Exclude: .gitmodules
[INFO] Exclude: .idea/**
[INFO] Exclude: */jdiff/*.xml
[INFO] Exclude: .travis.yml
[INFO] Exclude: licenses/**
[INFO] Exclude: protobuf_install/**
[INFO] Exclude: thrift-0.13.0/**
[INFO] Exclude: thrift-0.13.0.tar.gz
[INFO] Exclude:**/dependency-reduced-pom.xml
[INFO] 28 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 0, approved: 22 licenses.
[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ parquet ---
[INFO] 
[INFO] --- maven-failsafe-plugin:2.10:integration-test (default) @ parquet ---
[INFO] No tests to run.
[INFO] Failsafe report directory: D:\parquet-mr\target\failsafe-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-failsafe-plugin:2.10:verify (default) @ parquet ---
[INFO] No tests to run.
[INFO] 
[INFO] --- japicmp-maven-plugin:0.14.2:cmp (default) @ parquet ---
[INFO] Skipping execution because parameter 'skip' was set to true.
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ parquet ---
[INFO] Installing D:\parquet-mr\pom.xml to C:\Users\USERNAME\.m2\repository\org\apache\parquet\parquet\1.12.0-SNAPSHOT\parquet-1.12.0-SNAPSHOT.pom
[INFO] 
[INFO] ------------< org.apache.parquet:parquet-format-structures >------------
[INFO] Building Apache Parquet Format Structures 1.12.0-SNAPSHOT         [2/31]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ parquet-format-structures ---
[INFO] Deleting D:\parquet-mr\parquet-format-structures\target
[INFO] 
[INFO] --- buildnumber-maven-plugin:1.1:create (default) @ parquet-format-structures ---
[INFO] Checking for local modifications: skipped.
[INFO] Updating project files from SCM: skipped.
[INFO] Executing: cmd.exe /X /C "git rev-parse --verify HEAD"
[INFO] Working directory: D:\parquet-mr\parquet-format-structures
[INFO] Storing buildNumber: 5c6916c23cb2b9c225ea80328550ee0e11aee225 at timestamp: 1606499723467
[INFO] Executing: cmd.exe /X /C "git rev-parse --verify HEAD"
[INFO] Working directory: D:\parquet-mr\parquet-format-structures
[INFO] Storing buildScmBranch: UNKNOWN
[INFO] 
[INFO] --- maven-dependency-plugin:2.8:unpack (unpack) @ parquet-format-structures ---
[INFO] Configured Artifact: org.apache.parquet:parquet-format:2.8.0:jar
[INFO] Unpacking C:\Users\USERNAME\.m2\repository\org\apache\parquet\parquet-format\2.8.0\parquet-format-2.8.0.jar to D:\parquet-mr\parquet-format-structures\target\parquet-format-thrift with includes "parquet.thrift" and excludes ""
[INFO] 
[INFO] --- thrift-maven-plugin:0.10.0:compile (thrift-sources) @ parquet-format-structures ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ parquet-format-structures ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ parquet-format-structures ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory D:\parquet-mr\parquet-format-structures\src\main\resources
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ parquet-format-structures ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 66 source files to D:\parquet-mr\parquet-format-structures\target\classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR : 
[INFO] -------------------------------------------------------------
[ERROR] /D:/parquet-mr/parquet-format-structures/src/main/java/org/apache/parquet/format/Util.java:[340,21] unreported exception org.apache.thrift.transport.TTransportException; must be caught or declared to be thrown
[ERROR] /D:/parquet-mr/parquet-format-structures/src/main/java/org/apache/parquet/format/Util.java:[344,21] unreported exception org.apache.thrift.transport.TTransportException; must be caught or declared to be thrown
[ERROR] /D:/parquet-mr/parquet-format-structures/src/main/java/org/apache/parquet/format/InterningProtocol.java:[37,8] org.apache.parquet.format.InterningProtocol is not abstract and does not override abstract method getMinSerializedSize(byte) in org.apache.thrift.protocol.TProtocol
[INFO] 3 errors 
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Apache Parquet MR 1.12.0-SNAPSHOT:
[INFO] 
[INFO] Apache Parquet MR .................................. SUCCESS [  4.104 s]
[INFO] Apache Parquet Format Structures ................... FAILURE [  6.352 s]
[INFO] Apache Parquet Generator ........................... SKIPPED
[INFO] Apache Parquet Common .............................. SKIPPED
[INFO] Apache Parquet Encodings ........................... SKIPPED
[INFO] Apache Parquet Column .............................. SKIPPED
[INFO] Apache Parquet Arrow ............................... SKIPPED
[INFO] Apache Parquet Jackson ............................. SKIPPED
[INFO] Apache Parquet Hadoop .............................. SKIPPED
[INFO] Apache Parquet Avro ................................ SKIPPED
[INFO] Apache Parquet Benchmarks .......................... SKIPPED
[INFO] Apache Parquet Pig ................................. SKIPPED
[INFO] Apache Parquet Thrift .............................. SKIPPED
[INFO] Apache Parquet Cascading ........................... SKIPPED
[INFO] Apache Parquet Cascading (for Cascading 3.0 onwards) SKIPPED
[INFO] Apache Parquet Command-line ........................ SKIPPED
[INFO] Apache Parquet Pig Bundle .......................... SKIPPED
[INFO] Apache Parquet Protobuf ............................ SKIPPED
[INFO] Apache Parquet Scala ............................... SKIPPED
[INFO] Apache Parquet Scrooge ............................. SKIPPED
[INFO] Apache Parquet Hadoop Bundle ....................... SKIPPED
[INFO] Apache Parquet Hive ................................ SKIPPED
[INFO] Apache Parquet Hive Binding Parent ................. SKIPPED
[INFO] Apache Parquet Hive Binding Interface .............. SKIPPED
[INFO] Apache Parquet Hive 0.10 Binding ................... SKIPPED
[INFO] Apache Parquet Hive 0.12 Binding ................... SKIPPED
[INFO] Apache Parquet Hive Binding Factory ................ SKIPPED
[INFO] Apache Parquet Hive Binding Bundle ................. SKIPPED
[INFO] Apache Parquet Hive Storage Handler ................ SKIPPED
[INFO] Apache Parquet Hive Bundle ......................... SKIPPED
[INFO] Apache Parquet Tools ............................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  10.761 s
[INFO] Finished at: 2020-11-27T23:25:29+05:30
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project parquet-format-structures: Compilation failure: Compilation failure: 
[ERROR] /D:/parquet-mr/parquet-format-structures/src/main/java/org/apache/parquet/format/Util.java:[340,21] unreported exception org.apache.thrift.transport.TTransportException; must be caught or declared to be thrown
[ERROR] /D:/parquet-mr/parquet-format-structures/src/main/java/org/apache/parquet/format/Util.java:[344,21] unreported exception org.apache.thrift.transport.TTransportException; must be caught or declared to be thrown
[ERROR] /D:/parquet-mr/parquet-format-structures/src/main/java/org/apache/parquet/format/InterningProtocol.java:[37,8] org.apache.parquet.format.InterningProtocol is not abstract and does not override abstract method getMinSerializedSize(byte) in org.apache.thrift.protocol.TProtocol
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :parquet-format-structures

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题