我正在尝试将一个表从hdfs导出到sqoop，但是我遇到了java异常。我使用的查询如下：
sqoop export --connect jdbc:mysql://172.31.54.174/Database --driver com.mysql.jdbc.Driver --username user --password userpassword --table accounts --export-dir /user/pri/accounts执行此查询时出现以下错误：
17/03/29 07:54:26 INFO mapreduce.Job: map 0% reduce 0%
17/03/29 07:54:30 INFO mapreduce.Job: Task Id : attempt_1489328678238_4886_m_000002_0, Status : FAILED
Error: java.io.IOException: Can't export data, please check failed map task logs
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: Can't parse input data: '\N'
at accounts.__loadFromFields(accounts.java:691)
at accounts.parse(accounts.java:584)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:204)
at accounts.__loadFromFields(accounts.java:643)
... 12 more我正在导出的文件包含以下数据：
1,2008-10-23 16:05:05.0,\N,Donald,Becton,2275 Washburn Street,Oakland,CA,94660,5100032418,2014-03-18 13:29:47.0,2014-03-18 13:29:47.0
2,2008-11-12 03:00:01.0,\N,Donna,Jones,3885 Elliott Street,San Francisco,CA,94171,4150835799,2014-03-18 13:29:47.0,2014-03-18 13:29:47.0我还创建了accounts表，其结构如下： `+
8条答案
按热度按时间pdsfdshx1#
---+------+-----+---------+-------+ | acct_num | varchar(20) | NO | PRI | | | | acct_create_dt | datetime | NO | | NULL | | | acc_close_dt | datetime | YES | | NULL | | | first_name | varchar(20) | NO | | NULL | | | last_name | varchar(20) | NO | | NULL | | | address | varchar(30) | NO | | NULL | | | city | varchar(20) | NO | | NULL | | | state | varchar(20) | NO | | NULL | | | zipcode | varchar(20) | NO | | NULL | | | phone_number | varchar(20) | YES | | NULL | | | created | datetime | NO | | NULL | | | modified | datetime | NO | | NULL | | +
esbemjvw2#
------+
ljsrvy3e3#
---+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +
vxqlmq5t4#
------+
yruzcnhs5#
添加
--input-null-string '\\N' --input-null-non-string '\\N'在sqoop导出命令中。exdqitrt6#
------+
jqjz2hbq7#
---+------+-----+---------+-------+` 我还附上了一个错误的截图。
n8ghc7c18#
从日志中可以看出，'\n'类似于转义字符，因此不适合varchar。我不明白为什么要添加相同的字符。此外，还指出了时间戳格式问题。如果主键使用的任何列本身重复，请检查现有数据。