spark solr使用maven问题构建jar

kknvjkwl  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(416)

我正在努力使用maven for spark solr构建jar文件。最有可能是由于scala版本，但我不知道如何处理。我已经安装了scala 2.10.5和spark 1.6.2，我正在运行mvn clean package-dskiptests-e
下面是我得到的错误。

  1. [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-solr: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> [Help 1]
  2. org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-solr: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
  3.         at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
  4.         at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
  5.         at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
  6.         at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
  7.         at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
  8.         at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
  9.         at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
  10.         at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
  11.         at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
  12.         at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
  13.         at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
  14.         at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
  15.         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  16.         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  17.         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  18.         at java.lang.reflect.Method.invoke(Method.java:498)
  19.         at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
  20.         at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
  21.         at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
  22.         at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
  23. Caused by: org.apache.maven.plugin.PluginExecutionException: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
  24.         at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:144)
  25.         at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
  26.         ... 19 more
  28. [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException

非常感谢你的帮助。
下面是pom.xml

  1. <?xml version="1.0"?>
  2. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  3.   <modelVersion>4.0.0</modelVersion>
  4.   <groupId>com.lucidworks.spark</groupId>
  5.   <artifactId>spark-solr</artifactId>
  6.   <version>2.2.0</version>
  7.   <packaging>jar</packaging>
  8.   <name>spark-solr</name>
  9.   <description>Tools for reading data from Spark into Solr</description>
  10.   <url>https://github.com/LucidWorks/spark-solr</url>
  11.   <licenses>
  12.     <license>
  13.       <name>Apache License, Version 2.0</name>
  14.       <url>http://www.apache.org/licenses/LICENSE-2.0.txt</url>
  15.       <distribution>repo</distribution>
  16.       <comments>A business-friendly OSS license</comments>
  17.     </license>
  18.   </licenses>
  19.   <developers>
  20.     <developer>
  21.       <name>Lucidworks</name>
  22.       <organization>Lucidworks</organization>
  23.       <organizationUrl>www.lucidworks.com</organizationUrl>
  24.     </developer>
  25.   </developers>
  26.   <scm>
  27.     <connection>scm:git:git@github.com:LucidWorks/spark-solr.git</connection>
  28.     <developerConnection>scm:git:git@github.com:LucidWorks/spark-solr.git</developerConnection>
  29.     <url>https://github.com/LucidWorks/spark-solr</url>
  30.   </scm>
  31.   <distributionManagement>
  32.     <snapshotRepository>
  33.       <id>ossrh</id>
  34.       <url>https://oss.sonatype.org/content/repositories/snapshots</url>
  35.     </snapshotRepository>
  36.   </distributionManagement>
  37.   <properties>
  38.     <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  39.     <java.version>1.8</java.version>
  40.     <spark.version>1.6.2</spark.version>
  41.     <solr.version>6.1.0</solr.version>
  42.     <fasterxml.version>2.4.0</fasterxml.version>
  43.     <scala.version>2.10.5</scala.version>
  44.     <scala.binary.version>2.10</scala.binary.version>
  45.     <scoverage.plugin.version>1.1.1</scoverage.plugin.version>
  46.     <MaxPermSize>128m</MaxPermSize>
  47.   </properties>
  48.   <profiles>
  49.     <profile>
  50.       <id>release</id>
  51.       <build>
  52.         <plugins>
  53.           <plugin>
  54.             <groupId>org.apache.maven.plugins</groupId>
  55.             <artifactId>maven-javadoc-plugin</artifactId>
  56.             <version>2.10.3</version>
  57.             <executions>
  58.               <execution>
  59.                 <id>attach-javadocs</id>
  60.                 <goals>
  61.                   <goal>jar</goal>
  62.                 </goals>
  63.               </execution>
  64.             </executions>
  65.           </plugin>
  66.           <plugin>
  67.             <groupId>org.apache.maven.plugins</groupId>
  68.             <artifactId>maven-gpg-plugin</artifactId>
  69.             <version>1.6</version>
  70.             <executions>
  71.               <execution>
  72.                 <id>sign-artifacts</id>
  73.                 <phase>verify</phase>
  74.                 <goals>
  75.                   <goal>sign</goal>
  76.                 </goals>
  77.               </execution>
  78.             </executions>
  79.           </plugin>
  80.         </plugins>
  81.       </build>
  82.     </profile>
  83.     <profile>
  84.       <id>coverage</id>
  85.       <activation>
  86.         <activeByDefault>false</activeByDefault>
  87.       </activation>
  88.       <build>
  89.         <plugins>
  90.           <plugin>
  91.             <groupId>org.jacoco</groupId>
  92.             <artifactId>jacoco-maven-plugin</artifactId>
  93.             <version>0.7.4.201502262128</version>
  94.             <configuration>
  95.               <excludes>
  96.               <exclude>com/lucidworks/spark/example/**</exclude>
  97.               <exclude>**/*Test*</exclude>
  98.               </excludes>
  99.             </configuration>
  100.             <executions>
  101.               <execution>
  102.                 <id>default-prepare-agent</id>
  103.                 <goals>
  104.                   <goal>prepare-agent</goal>
  105.                 </goals>
  106.               </execution>
  107.               <execution>
  108.                 <id>default-report</id>
  109.                 <phase>package</phase>
  110.                 <goals>
  111.                   <goal>report</goal>
  112.                 </goals>
  113.               </execution>
  114.             </executions>
  115.           </plugin>
  116.           <plugin>
  117.             <groupId>org.scoverage</groupId>
  118.             <artifactId>scoverage-maven-plugin</artifactId>
  119.             <version>${scoverage.plugin.version}</version>
  120.             <configuration>
  121.               <scalaVersion>${scala.version}</scalaVersion>
  122.             </configuration>
  123.           </plugin>
  124.           <plugin>
  125.             <groupId>org.apache.maven.plugins</groupId>
  126.             <artifactId>maven-surefire-plugin</artifactId>
  127.             <version>2.18.1</version>
  128.             <configuration>
  129.               <argLine>${argLine} -XX:MaxPermSize=${MaxPermSize}</argLine>
  130.             </configuration>
  131.           </plugin>
  132.         </plugins>
  133.       </build>
  134.     </profile>
  135.   </profiles>
  136.   <build>
  137.     <plugins>
  138.       <plugin>
  139.         <groupId>net.alchim31.maven</groupId>
  140.         <artifactId>scala-maven-plugin</artifactId>
  141.         <version>3.2.2</version>
  142.         <executions>
  143.           <execution>
  144.             <id>eclipse-add-source</id>
  145.             <goals>
  146.               <goal>add-source</goal>
  147.             </goals>
  148.           </execution>
  149.           <execution>
  150.             <id>scala-compile-first</id>
  151.             <phase>process-resources</phase>
  152.             <goals>
  153.               <goal>compile</goal>
  154.             </goals>
  155.           </execution>
  156.           <execution>
  157.             <id>scala-test-compile-first</id>
  158.             <phase>process-test-resources</phase>
  159.             <goals>
  160.               <goal>testCompile</goal>
  161.             </goals>
  162.           </execution>
  163.           <execution>
  164.             <id>attach-scaladocs</id>
  165.             <phase>verify</phase>
  166.             <goals>
  167.               <goal>doc-jar</goal>
  168.             </goals>
  169.           </execution>
  170.         </executions>
  171.         <configuration>
  172.           <scalaVersion>${scala.version}</scalaVersion>
  173.           <recompileMode>incremental</recompileMode>
  174.           <useZincServer>true</useZincServer>
  175.           <javacArgs>
  176.             <javacArg>-source</javacArg>
  177.             <javacArg>${java.version}</javacArg>
  178.             <javacArg>-target</javacArg>
  179.             <javacArg>${java.version}</javacArg>
  180.           </javacArgs>
  181.         </configuration>
  182.       </plugin>
  183.       <plugin>
  184.         <artifactId>maven-compiler-plugin</artifactId>
  185.         <version>3.0</version>
  186.         <configuration>
  187.           <source>${java.version}</source>
  188.           <target>${java.version}</target>
  189.         </configuration>
  190.       </plugin>
  191.       <plugin>
  192.         <groupId>org.codehaus.mojo</groupId>
  193.         <artifactId>versions-maven-plugin</artifactId>
  194.         <version>2.3</version>
  195.       </plugin>
  196.       <!-- Surefire runs Java tests -->
  197.       <plugin>
  198.         <groupId>org.apache.maven.plugins</groupId>
  199.         <artifactId>maven-surefire-plugin</artifactId>
  200.         <version>2.18.1</version>
  201.         <configuration>
  202.           <argLine> -XX:MaxPermSize=${MaxPermSize}</argLine>
  203.         </configuration>
  204.       </plugin>
  205.       <!-- ScalaTest runs Scala tests -->
  206.       <plugin>
  207.         <groupId>org.scalatest</groupId>
  208.         <artifactId>scalatest-maven-plugin</artifactId>
  209.         <version>1.0</version>
  210.         <configuration>
  211.           <stderr/>
  212.           <!-- Log to stderr -->
  213.           <junitxml>.</junitxml>
  214.           <!-- Directory/ies for JUnit XML -->
  215.           <reportsDirectory>${project.build.directory}/surefire-reports</reportsDirectory>
  216.           <argLine>-ea -XX:MaxPermSize=${MaxPermSize}</argLine>
  217.           <systemProperties>
  218.             <java.awt.headless>true</java.awt.headless>
  219.             <java.io.tmpdir>${project.build.directory}/tmp</java.io.tmpdir>
  220.           </systemProperties>
  221.         </configuration>
  222.         <executions>
  223.           <execution>
  224.             <id>test</id>
  225.             <goals>
  226.               <goal>test</goal>
  227.             </goals>
  228.           </execution>
  229.         </executions>
  230.       </plugin>
  231.       <plugin>
  232.         <groupId>org.apache.maven.plugins</groupId>
  233.         <artifactId>maven-shade-plugin</artifactId>
  234.         <version>2.3</version>
  235.         <executions>
  236.           <execution>
  237.             <phase>package</phase>
  238.             <goals>
  239.               <goal>shade</goal>
  240.             </goals>
  241.             <configuration>
  242.               <shadedArtifactAttached>true</shadedArtifactAttached>
  243.               <shadedClassifierName>shaded</shadedClassifierName>
  244.               <filters>
  245.                 <filter>
  246.                   <artifact>*:*</artifact>
  247.                   <excludes>
  248.                     <exclude>META-INF/*.SF</exclude>
  249.                     <exclude>META-INF/*.DSA</exclude>
  250.                     <exclude>META-INF/*.RSA</exclude>
  251.                   </excludes>
  252.                 </filter>
  253.               </filters>
  254.               <artifactSet>
  255.                 <excludes>
  256.                   <exclude>org.apache.spark:spark-core_${scala.binary.version}</exclude>
  257.                   <exclude>org.apache.spark:spark-streaming_${scala.binary.version}</exclude>
  258.                   <exclude>org.apache.spark:spark-hive_${scala.binary.version}</exclude>
  259.                   <exclude>org.apache.hadoop:*</exclude>
  260.                   <exclude>com.google.protobuf_spark:*</exclude>
  261.                   <exclude>com.twitter:chill_${scala.binary.version}</exclude>
  262.                   <exclude>com.twitter:chill-java</exclude>
  263.                   <exclude>org.spark-project.akka:*</exclude>
  264.                   <exclude>org.spark-project:*</exclude>
  265.                   <exclude>net.java.dev.jets3t:jets3t</exclude>
  266.                   <exclude>org.eclipse.jetty:*</exclude>
  267.                   <exclude>org.eclipse.jetty.orbit:*</exclude>
  268.                   <exclude>org.slf4j:*</exclude>
  269.                   <exclude>org.scala-lang:scala-library</exclude>
  270.                   <exclude>commons-httpclient:commons-httpclient</exclude>
  271.                   <exclude>org.apache.curator:*</exclude>
  272.                   <exclude>org.apache.commons:commons-lang3</exclude>
  273.                   <exclude>com.google.code.findbugs</exclude>
  274.                   <exclude>com.ning:compress-lzf</exclude>
  275.                   <exclude>org.xerial.snappy:snappy-java</exclude>
  276.                   <exclude>net.jpountz.lz4:lz4</exclude>
  277.                   <exclude>com.esotericsoftware.kryo:*</exclude>
  278.                   <exclude>log4j:log4j</exclude>
  279.                   <exclude>com.esotericsoftware.reflectasm:reflectasm</exclude>
  280.                   <exclude>com.esotericsoftware.minlog:minlog</exclude>
  281.                   <exclude>org.objenesis:objenesis</exclude>
  282.                   <exclude>commons-net:commons-net</exclude>
  283.                   <exclude>org.apache.james:*</exclude>
  284.                   <exclude>org.ow2.asm:asm-debug-all</exclude>
  285.                   <exclude>javax.xml.stream:stax-api</exclude>
  286.                   <exclude>javax.ws.rs:javax.ws.rs-api</exclude>
  287.                   <exclude>xml-apis:xml-apis</exclude>
  288.                   <exclude>org.ow2.asm:asm</exclude>
  289.                   <exclude>com.codahale.metrics:*</exclude>
  290.                   <exclude>io.dropwizard.metrics:*</exclude>
  291.                   <exclude>com.sun.xml.bind:jaxb-impl</exclude>
  292.                   <exclude>com.sun.jersey:jersey-client</exclude>
  293.                   <exclude>org.mortbay.jetty:jetty-util</exclude>
  294.                 </excludes>
  295.               </artifactSet>
  296.               <relocations>
  297.                 <relocation>
  298.                   <pattern>org.apache.http</pattern>
  299.                   <shadedPattern>shaded.apache.http</shadedPattern>
  300.                 </relocation>
  301.                 <relocation>
  302.                   <pattern>org.codehaus.jackson</pattern>
  303.                   <shadedPattern>shaded.codehaus.jackson</shadedPattern>
  304.                 </relocation>
  305.                 <relocation>
  306.                   <pattern>com.fasterxml.jackson</pattern>
  307.                   <shadedPattern>shaded.fasterxml.jackson</shadedPattern>
  308.                 </relocation>
  309.                 <relocation>
  310.                   <pattern>org.objectweb.asm</pattern>
  311.                   <shadedPattern>shaded.objectweb.asm</shadedPattern>
  312.                 </relocation>
  313.                 <relocation>
  314.                   <pattern>org.joda.time</pattern>
  315.                   <shadedPattern>shaded.joda.time</shadedPattern>
  316.                 </relocation>
  317.                 <relocation>
  318.                   <pattern>com.google.guava</pattern>
  319.                   <shadedPattern>shaded.google.guava</shadedPattern>
  320.                 </relocation>
  321.                 <relocation>
  322.                   <pattern>com.sun.jersey</pattern>
  323.                   <shadedPattern>shaded.sun.jersey</shadedPattern>
  324.                 </relocation>
  325.                 <relocation>
  326.                   <pattern>javax.ws.rs</pattern>
  327.                   <shadedPattern>shaded.javax.ws.rs</shadedPattern>
  328.                 </relocation>
  329.                 <!-- Commented out because the maven-shade-plugin does not work for Scala classes due to ScalaSig-->
  330.                 <!--<relocation>-->
  331.                   <!--<pattern>org.apache.solr</pattern>-->
  332.                   <!--<shadedPattern>shaded.apache.solr</shadedPattern>-->
  333.                 <!--</relocation>-->
  334.                 <relocation>
  335.                   <pattern>org.apache.commons.cli</pattern>
  336.                   <shadedPattern>shaded.apache.commons.cli</shadedPattern>
  337.                 </relocation>
  338.               </relocations>
  339.             </configuration>
  340.           </execution>
  341.         </executions>
  342.       </plugin>
  343.       <plugin>
  344.         <groupId>org.apache.maven.plugins</groupId>
  345.         <artifactId>maven-source-plugin</artifactId>
  346.         <version>2.4</version>
  347.         <executions>
  348.           <execution>
  349.             <id>attach-sources</id>
  350.             <goals>
  351.               <goal>jar</goal>
  352.             </goals>
  353.           </execution>
  354.         </executions>
  355.       </plugin>
  356.       <plugin>
  357.         <groupId>org.sonatype.plugins</groupId>
  358.         <artifactId>nexus-staging-maven-plugin</artifactId>
  359.         <version>1.6.6</version>
  360.         <extensions>true</extensions>
  361.         <configuration>
  362.           <serverId>ossrh</serverId>
  363.           <nexusUrl>https://oss.sonatype.org/</nexusUrl>
  364.           <autoReleaseAfterClose>true</autoReleaseAfterClose>
  365.         </configuration>
  366.       </plugin>
  367.     </plugins>
  368.   </build>
  369.   <dependencies>
  370.     <dependency>
  371.       <groupId>org.apache.spark</groupId>
  372.       <artifactId>spark-core_${scala.binary.version}</artifactId>
  373.       <version>${spark.version}</version>
  374.       <scope>provided</scope>
  375.       <exclusions>
  376.         <exclusion>
  377.           <groupId>org.eclipse.jetty.orbit</groupId>
  378.           <artifactId>javax.servlet</artifactId>
  379.         </exclusion>
  380.       </exclusions>
  381.     </dependency>
  382.     <dependency>
  383.       <groupId>com.esotericsoftware.kryo</groupId>
  384.       <artifactId>kryo</artifactId>
  385.       <version>2.21</version>
  386.       <scope>compile</scope>
  387.     </dependency>
  388.     <dependency>
  389.       <groupId>com.codahale.metrics</groupId>
  390.       <artifactId>metrics-core</artifactId>
  391.       <version>3.0.0</version>
  392.       <scope>compile</scope>
  393.     </dependency>
  394.     <dependency>
  395.       <groupId>org.apache.spark</groupId>
  396.       <artifactId>spark-streaming_${scala.binary.version}</artifactId>
  397.       <version>${spark.version}</version>
  398.       <scope>provided</scope>
  399.     </dependency>
  400.     <dependency>
  401.       <groupId>org.apache.spark</groupId>
  402.       <artifactId>spark-mllib_${scala.binary.version}</artifactId>
  403.       <version>${spark.version}</version>
  404.     </dependency>
  405.     <dependency>
  406.       <groupId>org.apache.spark</groupId>
  407.       <artifactId>spark-streaming-twitter_${scala.binary.version}</artifactId>
  408.       <version>${spark.version}</version>
  409.     </dependency>
  410.     <dependency>
  411.       <groupId>commons-cli</groupId>
  412.       <artifactId>commons-cli</artifactId>
  413.       <version>1.3.1</version>
  414.     </dependency>
  415.     <dependency>
  416.       <groupId>commons-io</groupId>
  417.       <artifactId>commons-io</artifactId>
  418.       <version>2.3</version>
  419.     </dependency>
  420.     <dependency>
  421.       <groupId>org.apache.solr</groupId>
  422.       <artifactId>solr-solrj</artifactId>
  423.       <version>${solr.version}</version>
  424.       <type>jar</type>
  425.     </dependency>
  426.     <dependency>
  427.       <groupId>org.apache.solr</groupId>
  428.       <artifactId>solr-core</artifactId>
  429.       <version>${solr.version}</version>
  430.       <type>jar</type>
  431.     </dependency>
  432.     <dependency>
  433.       <groupId>org.apache.solr</groupId>
  434.       <artifactId>solr-test-framework</artifactId>
  435.       <version>${solr.version}</version>
  436.       <type>jar</type>
  437.       <scope>test</scope>
  438.     </dependency>
  439.     <dependency>
  440.       <groupId>org.apache.hadoop</groupId>
  441.       <artifactId>hadoop-client</artifactId>
  442.       <version>2.6.0</version>
  443.       <scope>compile</scope>
  444.       <exclusions>
  445.         <exclusion>
  446.           <groupId>org.slf4j</groupId>
  447.           <artifactId>slf4j-log4j12</artifactId>
  448.         </exclusion>
  449.         <exclusion>
  450.           <groupId>javax.servlet</groupId>
  451.           <artifactId>servlet-api</artifactId>
  452.         </exclusion>
  453.         <exclusion>
  454.           <groupId>org.restlet.jee</groupId>
  455.           <artifactId>org.restlet.ext.servlet</artifactId>
  456.         </exclusion>
  457.       </exclusions>
  458.     </dependency>
  459.     <dependency>
  460.       <groupId>org.apache.hadoop</groupId>
  461.       <artifactId>hadoop-common</artifactId>
  462.       <version>2.6.0</version>
  463.       <scope>compile</scope>
  464.       <exclusions>
  465.         <exclusion>
  466.           <groupId>org.slf4j</groupId>
  467.           <artifactId>slf4j-log4j12</artifactId>
  468.         </exclusion>
  469.         <exclusion>
  470.           <groupId>javax.servlet</groupId>
  471.           <artifactId>servlet-api</artifactId>
  472.         </exclusion>
  473.         <exclusion>
  474.           <groupId>org.restlet.jee</groupId>
  475.           <artifactId>org.restlet.ext.servlet</artifactId>
  476.         </exclusion>
  477.         <exclusion>
  478.           <groupId>javax.servlet.jsp</groupId>
  479.           <artifactId>jsp-api</artifactId>
  480.         </exclusion>
  481.       </exclusions>
  482.     </dependency>
  483.     <dependency>
  484.       <groupId>org.apache.commons</groupId>
  485.       <artifactId>commons-lang3</artifactId>
  486.       <version>3.3.2</version>
  487.     </dependency>
  488.     <dependency>
  489.       <groupId>junit</groupId>
  490.       <artifactId>junit</artifactId>
  491.       <version>4.11</version>
  492.       <scope>test</scope>
  493.     </dependency>
  494.     <dependency>
  495.       <groupId>com.fasterxml.jackson.core</groupId>
  496.       <artifactId>jackson-core</artifactId>
  497.       <version>${fasterxml.version}</version>
  498.     </dependency>
  499.     <dependency>
  500.       <groupId>com.fasterxml.jackson.core</groupId>
  501.       <artifactId>jackson-databind</artifactId>
  502.       <version>${fasterxml.version}</version>
  503.     </dependency>
  504.     <dependency>
  505.       <groupId>com.fasterxml.jackson.module</groupId>
  506.       <artifactId>jackson-module-scala_${scala.binary.version}</artifactId>
  507.       <version>${fasterxml.version}</version>
  508.     </dependency>
  509.     <dependency>
  510.       <groupId>org.scala-lang</groupId>
  511.       <artifactId>scala-library</artifactId>
  512.       <version>${scala.version}</version>
  513.     </dependency>
  514.     <dependency>
  515.       <groupId>org.apache.spark</groupId>
  516.       <artifactId>spark-core_${scala.binary.version}</artifactId>
  517.       <version>${spark.version}</version>
  518.       <classifier>tests</classifier>
  519.       <scope>test</scope>
  520.     </dependency>
  521.     <dependency>
  522.       <groupId>org.apache.spark</groupId>
  523.       <artifactId>spark-mllib_${scala.binary.version}</artifactId>
  524.       <version>${spark.version}</version>
  525.       <classifier>tests</classifier>
  526.       <scope>test</scope>
  527.     </dependency>
  528.     <dependency>
  529.       <groupId>org.scalatest</groupId>
  530.       <artifactId>scalatest_${scala.binary.version}</artifactId>
  531.       <version>2.2.1</version>
  532.       <scope>test</scope>
  533.     </dependency>
  534.     <dependency>
  535.       <groupId>org.apache.spark</groupId>
  536.       <artifactId>spark-hive_${scala.binary.version}</artifactId>
  537.       <version>${spark.version}</version>
  538.     </dependency>
  539.     <dependency>
  540.       <groupId>com.databricks</groupId>
  541.       <artifactId>spark-csv_${scala.binary.version}</artifactId>
  542.       <version>1.4.0</version>
  543.     </dependency>
  544.     <dependency>
  545.       <groupId>org.apache.commons</groupId>
  546.       <artifactId>commons-compress</artifactId>
  547.       <version>1.4.1</version>
  548.     </dependency>
  549.     <dependency> <!-- optional dependency of joda-time that is mandatory in Scala -->
  550.       <groupId>org.joda</groupId>
  551.       <artifactId>joda-convert</artifactId>
  552.       <version>1.2</version>
  553.     </dependency>
  554.     <dependency>
  555.       <groupId>com.github.tomakehurst</groupId>
  556.       <artifactId>wiremock</artifactId>
  557.       <version>1.56</version>
  559.       <!-- Include everything below here if you have dependency conflicts -->
  560.       <classifier>standalone</classifier>
  561.       <exclusions>
  562.         <exclusion>
  563.           <groupId>org.mortbay.jetty</groupId>
  564.           <artifactId>jetty</artifactId>
  565.         </exclusion>
  566.         <exclusion>
  567.           <groupId>com.google.guava</groupId>
  568.           <artifactId>guava</artifactId>
  569.         </exclusion>
  570.         <exclusion>
  571.           <groupId>com.fasterxml.jackson.core</groupId>
  572.           <artifactId>jackson-core</artifactId>
  573.         </exclusion>
  574.         <exclusion>
  575.           <groupId>com.fasterxml.jackson.core</groupId>
  576.           <artifactId>jackson-annotations</artifactId>
  577.         </exclusion>
  578.         <exclusion>
  579.           <groupId>com.fasterxml.jackson.core</groupId>
  580.           <artifactId>jackson-databind</artifactId>
  581.         </exclusion>
  582.         <exclusion>
  583.           <groupId>org.apache.httpcomponents</groupId>
  584.           <artifactId>httpclient</artifactId>
  585.         </exclusion>
  586.         <exclusion>
  587.           <groupId>org.skyscreamer</groupId>
  588.           <artifactId>jsonassert</artifactId>
  589.         </exclusion>
  590.         <exclusion>
  591.           <groupId>xmlunit</groupId>
  592.           <artifactId>xmlunit</artifactId>
  593.         </exclusion>
  594.         <exclusion>
  595.           <groupId>com.jayway.jsonpath</groupId>
  596.           <artifactId>json-path</artifactId>
  597.         </exclusion>
  598.         <exclusion>
  599.           <groupId>net.sf.jopt-simple</groupId>
  600.           <artifactId>jopt-simple</artifactId>
  601.         </exclusion>
  602.         <exclusion>
  603.           <groupId>org.apache.httpcomponents</groupId>
  604.           <artifactId>httpclient</artifactId>
  605.         </exclusion>
  606.         <exclusion>
  607.           <groupId>org.apache.httpcomponents</groupId>
  608.           <artifactId>httpcore</artifactId>
  609.         </exclusion>
  610.       </exclusions>
  611.       <scope>test</scope>
  612.     </dependency>
  613.   </dependencies>
  614. </project>
hadoopMavenapache-sparksolrJar

暂无答案！

目前还没有任何答案，快来回答吧！

我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com