我正在针对Hadoop 2.7构建Spark 3.2.0，但失败了。
$ git clone -b v3.2.0 https://github.com/apache/spark
$ mv spark spark-3.2.0
$ nohup sh -x dev/make-distribution.sh --tgz -Pyarn -Phadoop-2.7 -Dhadoop.version=2.7.2 -Phive -Phive-thriftserver -DskipTests > build.log 2>&1 &字符串
误差
[ERROR] [Error] /home/myuser/spark-3.2.0/core/src/test/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManagerSuite.scala:145: method reset in class UserGroupInformation cannot be accessed in object org.apache.hadoop.security.UserGroupInformation
...
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile (scala-test-compile-first) on project spark-core_2.12: Execution scala-test-compile-first of goal net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile failed.: CompileFailed -> [Help 1]型
的数据
1条答案
按热度按时间7cwmlq891#
你解决了吗？我也有同样的问题。hadoop 2.7.3 Spark 3.2.0 scala 2.12.18 mvn -Pyarn -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests clean package -e -X
[错误]无法在项目spark-core_2上执行goal net.alchim31.maven：scala-maven-plugin：4.3.0：testCompile（scala-test-compile-first）。12：执行目标net.alchim31.maven：scala-maven-plugin：4.3.0：testCompile的scala-test-compile-first失败。：CompileFailed -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException：无法在项目spark-core_2上执行goal net.alchim31.maven：scala-maven-plugin：4.3.0：testCompile（scala-test-compile-first）。12：执行目标net.alchim31.maven：scala-maven-plugin：4.3.0：testCompile的scala-test-compile-first失败。