使用sqoop将数据从redshift导入hive

9w11ddsr  于 2021-06-03  发布在  Sqoop
关注(0)|答案(1)|浏览(611)

我得到一个错误: Could not load db driver class .
连接和错误如下。下面是lib目录中jar文件的列表。我做错什么了?

  1. sqoop import
  2. --connect jdbc:redshift://< >
  3. --username < > --password < >
  4. --driver com.amazon.redshift.jdbc.Driver
  5. --table import-all-tables
  6. 17/04/21 11:14:46 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-258
  7. 17/04/21 11:14:46 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
  8. 17/04/21 11:14:46 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.
  9. 17/04/21 11:14:46 INFO manager.SqlManager: Using default fetchSize of 1000
  10. 17/04/21 11:14:46 INFO tool.CodeGenTool: Beginning code generation
  11. 17/04/21 11:14:46 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.amazon.redshift.jdbc.Driver
  12. java.lang.RuntimeException: Could not load db driver class: com.amazon.redshift.jdbc.Driver
  13. at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:856)
  14. at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
  15. at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:744)
  16. at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:767)
  17. at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:270)
  18. at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:241)
  19. at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:227)
  20. at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295)
  21. at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1845)
  22. at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1645)
  23. at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:107)
  24. at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
  25. at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
  26. at org.apache.sqoop.Sqoop.run(Sqoop.java:148)
  27. at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
  28. at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184)
  29. at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226)
  30. at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235)
  31. at org.apache.sqoop.Sqoop.main(Sqoop.java:244)
  32. [t lib]$ ls
  33. ant-contrib-1.0b3.jar hsqldb-1.8.0.10.jar kite-hadoop-compatibility-1.0.0.jar parquet-generator-1.4.1.jar
  34. ant-eclipse-1.0-jvm1.2.jar jackson-annotations-2.3.0.jar mysql-connector-java.jar parquet-hadoop-1.4.1.jar
  35. avro-1.7.5.jar jackson-core-2.3.1.jar opencsv-2.3.jar parquet-jackson-1.4.1.jar
  36. avro-mapred-1.7.5-hadoop2.jar jackson-core-asl-1.9.13.jar paranamer-2.3.jar RedshiftJDBC42-1.2.1.1001 (2).jar
  37. commons-codec-1.4.jar jackson-databind-2.3.1.jar parquet-avro-1.4.1.jar slf4j-api-1.6.1.jar
  38. commons-compress-1.4.1.jar jackson-mapper-asl-1.9.13.jar parquet-column-1.4.1.jar snappy-java-1.0.5.jar
  39. commons-io-1.4.jar kite-data-core-1.0.0.jar parquet-common-1.4.1.jar xz-1.0.jar
  40. commons-jexl-2.1.1.jar kite-data-hive-1.0.0.jar parquet-encoding-1.4.1.jar
  41. commons-logging-1.1.1.jar kite-data-mapreduce-1.0.0.jar parquet-format-2.0.0.jar
yvfmudvl

yvfmudvl1#

您的jdbc在sqoop/lib中不存在,所以请下载有效的jdbc驱动程序并复制到sqoop/lib

相关问题