sqoop导出因超时而失败

llycmphe  于 2021-06-02  发布在  Hadoop
关注(0)|答案(2)|浏览(531)

我无法将数据从sqoop导出到as400服务器。
我能够成功导入数据。
我正在使用以下命令:–

  1. sqoop export driver com.ibm.as400.access.AS400JDBCDriver connect jdbc:as400://178.xxx.3.21:23/MELLET1/TEXT4 –username xxxxxx –password xxxxx007 –table TEXT3 –export-dir /as400/1GBTBL5/part-m-00000 -m 1

我遇到了超时问题。

  1. >15/05/10 17:42:06 INFO input.FileInputFormat: Total input paths to process : 1
  2. 15/05/10 17:42:06 INFO input.FileInputFormat: Total input paths to process : 1
  3. 15/05/10 17:42:06 INFO mapreduce.JobSubmitter: number of splits:1
  4. 15/05/10 17:42:07 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1431267418859_0014
  5. 15/05/10 17:42:07 INFO impl.YarnClientImpl: Submitted application application_1431267418859_0014
  6. 15/05/10 17:42:07 INFO mapreduce.Job: Running job: job_1431267418859_0014
  7. 15/05/10 17:42:18 INFO mapreduce.Job: Job job_1431267418859_0014 running in uber mode : false
  8. 15/05/10 17:42:18 INFO mapreduce.Job: map 0% reduce 0%
  9. 15/05/10 17:42:37 INFO mapreduce.Job: map 100% reduce 0%
  10. 15/05/10 17:47:47 INFO mapreduce.Job: Task Id : attempt_1431267418859_0014_m_000000_0, Status : FAILED
  11. AttemptID:attempt_1431267418859_0014_m_000000_0 Timed out after 300 secs
  12. 15/05/10 17:47:48 INFO mapreduce.Job: map 0% reduce 0%
  13. 15/05/10 17:48:07 INFO mapreduce.Job: map 100% reduce 0%
  14. 15/05/10 17:53:16 INFO mapreduce.Job: Task Id : attempt_1431267418859_0014_m_000000_1, Status : FAILED
  15. AttemptID:attempt_1431267418859_0014_m_000000_1 Timed out after 300 secs
  16. 15/05/10 17:53:17 INFO mapreduce.Job: map 0% reduce 0%
  17. 15/05/10 17:53:40 INFO mapreduce.Job: map 100% reduce 0%
  18. 15/05/10 17:58:46 INFO mapreduce.Job: Task Id : attempt_1431267418859_0014_m_000000_2, Status : FAILED
  19. AttemptID:attempt_1431267418859_0014_m_000000_2 Timed out after 300 secs
k7fdbhmy

k7fdbhmy1#

请按照下面针对mysql的命令操作,同样您也可以相应地对数据库进行帧处理

  1. $ sqoop export --connect jdbc:mysql://db.example.com/foo --table bar --export-dir /results/bar_data
bfrts1fy

bfrts1fy2#

你试过批量模式吗?

  1. set -Dsqoop.export.records.per.statement and --batch

相关问题