hadoop maven依赖项错误-找不到hadoop类

y0u0uwnf  于 2021-06-03  发布在  Hadoop
关注(0)|答案(2)|浏览(696)

尽管我将以下依赖项导入到pom中,但是相关的hadoop类 (org.apache.hadoop.*) 不是进口的。

  1. <properties>
  2. <hadoop.version>1.0.4</hadoop.version>
  3. </properties>
  4. <!-- Apache Hadoop Core -->
  5. <dependency>
  6. <groupId>org.apache.hadoop</groupId>
  7. <artifactId>hadoop-client</artifactId>
  8. <version>${hadoop.version}</version>
  9. </dependency>
  10. <dependency>
  11. <groupId>org.apache.hadoop</groupId>
  12. <artifactId>hadoop-core</artifactId>
  13. <version>${hadoop.version}</version>
  14. </dependency>
  15. <dependency>
  16. <groupId>org.apache.hadoop</groupId>
  17. <artifactId>hadoop-examples</artifactId>
  18. <version>${hadoop.version}</version>
  19. </dependency>
  20. <dependency>
  21. <groupId>org.apache.hadoop</groupId>
  22. <artifactId>hadoop-tools</artifactId>
  23. <version>${hadoop.version}</version>
  24. </dependency>
tf7tbtn2

tf7tbtn21#

您可以使用下面的pom为项目解析hadoop依赖项。

  1. <repositories>
  2. <repository>
  3. <id>cloudera</id>
  4. <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
  5. </repository>
  6. </repositories>
  7. <properties>
  8. <hadoop-version>2.0.0-cdh4.2.0</hadoop-version>
  9. </properties>
  10. <dependencies>
  11. <dependency>
  12. <groupId>org.apache.hadoop</groupId>
  13. <artifactId>hadoop-annotations</artifactId>
  14. <version>${hadoop-version}</version>
  15. </dependency>
  16. <dependency>
  17. <groupId>org.apache.hadoop</groupId>
  18. <artifactId>hadoop-auth</artifactId>
  19. <version>${hadoop-version}</version>
  20. </dependency>
  21. <dependency>
  22. <groupId>org.apache.hadoop</groupId>
  23. <artifactId>hadoop-client</artifactId>
  24. <version>${hadoop-version}</version>
  25. </dependency>
  26. <dependency>
  27. <groupId>org.apache.hadoop</groupId>
  28. <artifactId>hadoop-common</artifactId>
  29. <version>${hadoop-version}</version>
  30. </dependency>
  31. <dependency>
  32. <groupId>org.apache.hadoop</groupId>
  33. <artifactId>hadoop-datajoin</artifactId>
  34. <version>${hadoop-version}</version>
  35. </dependency>
  36. <dependency>
  37. <groupId>org.apache.hadoop</groupId>
  38. <artifactId>hadoop-hdfs</artifactId>
  39. <version>${hadoop-version}</version>
  40. </dependency>
  41. <dependency>
  42. <groupId>org.apache.hadoop</groupId>
  43. <artifactId>hadoop-mapreduce-client-app</artifactId>
  44. <version>${hadoop-version}</version>
  45. </dependency>
  46. <dependency>
  47. <groupId>org.apache.hadoop</groupId>
  48. <artifactId>hadoop-common</artifactId>
  49. <version>${hadoop-version}</version>
  50. </dependency>
  51. <dependency>
  52. <groupId>org.apache.hadoop</groupId>
  53. <artifactId>hadoop-mapreduce-client-common</artifactId>
  54. <version>${hadoop-version}</version>
  55. </dependency>
  56. <dependency>
  57. <groupId>org.apache.hadoop</groupId>
  58. <artifactId>hadoop-mapreduce-client-hs</artifactId>
  59. <version>${hadoop-version}</version>
  60. </dependency>
  61. <dependency>
  62. <groupId>org.apache.hadoop</groupId>
  63. <artifactId>hadoop-mapreduce-client-jobclient</artifactId>
  64. <version>${hadoop-version}</version>
  65. </dependency>
  66. <dependency>
  67. <groupId>org.apache.hadoop</groupId>
  68. <artifactId>hadoop-mapreduce-client-shuffle</artifactId>
  69. <version>${hadoop-version}</version>
  70. </dependency>
  71. </dependencies>
展开查看全部
jv4diomz

jv4diomz2#

我在hadoop简单测试应用程序中使用以下依赖项:

  1. <dependency>
  2. <groupId>org.apache.hadoop</groupId>
  3. <artifactId>hadoop-annotations</artifactId>
  4. <version>2.2.0</version>
  5. </dependency>
  6. <dependency>
  7. <groupId>org.apache.hadoop</groupId>
  8. <artifactId>hadoop-hdfs</artifactId>
  9. <version>2.2.0</version>
  10. </dependency>
  11. <dependency>
  12. <groupId>org.apache.hadoop</groupId>
  13. <artifactId>hadoop-common</artifactId>
  14. <version>2.2.0</version>
  15. </dependency>
  16. <dependency>
  17. <groupId>org.apache.hadoop</groupId>
  18. <artifactId>hadoop-auth</artifactId>
  19. <version>2.2.0</version>
  20. </dependency>
  21. <dependency>
  22. <groupId>commons-logging</groupId>
  23. <artifactId>commons-logging</artifactId>
  24. <version>1.1.1</version>
  25. </dependency>
  26. <dependency>
  27. <groupId>commons-cli</groupId>
  28. <artifactId>commons-cli</artifactId>
  29. <version>1.2</version>
  30. </dependency>
  31. <dependency>
  32. <groupId>org.slf4j</groupId>
  33. <artifactId>slf4j-api</artifactId>
  34. <version>1.7.5</version>
  35. </dependency>
  36. <dependency>
  37. <groupId>commons-lang</groupId>
  38. <artifactId>commons-lang</artifactId>
  39. <version>2.6</version>
  40. </dependency>
  41. <dependency>
  42. <groupId>commons-configuration</groupId>
  43. <artifactId>commons-configuration</artifactId>
  44. <version>1.6</version>
  45. </dependency>
  46. <dependency>
  47. <groupId>com.google.guava</groupId>
  48. <artifactId>guava</artifactId>
  49. <version>11.0.2</version>
  50. </dependency>
  51. <dependency>
  52. <groupId>com.google.protobuf</groupId>
  53. <artifactId>protobuf-java</artifactId>
  54. <version>2.5.0</version>
  55. </dependency>
展开查看全部

相关问题