运行sqoop时出现oozie错误:无法从空字符串创建路径

dluptydi  于 2021-07-15  发布在  Hadoop
关注(0)|答案(0)|浏览(368)

我正在尝试用oozie运行sqoop导出。我可以运行简单的sqoop命令(list tables等),也可以从cmd行运行sqoop export命令,但是当我使用oozie运行时,我的yarn日志中出现以下错误:
错误:

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/mnt/resource/hadoop/yarn/local/filecache/41235/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/mnt/resource/hadoop/yarn/local/filecache/41709/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Note: /tmp/sqoop-yarn/compile/ff5ff27843de6fb697dddfb18c85dbbb/tmp_fact_kpi_da20.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

java.lang.IllegalArgumentException: Can not create a Path from an empty string
    at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126)
    at org.apache.hadoop.fs.Path.<init>(Path.java:134)
    at org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:127)
    at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:95)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:190)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
    at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
    at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
    at org.apache.sqoop.mapreduce.ExportJobBase.doSubmitJob(ExportJobBase.java:326)
    at org.apache.sqoop.mapreduce.ExportJobBase.runJob(ExportJobBase.java:303)
    at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:444)
    at org.apache.sqoop.manager.SQLServerManager.exportTable(SQLServerManager.java:192)
    at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81)
    at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
    at org.apache.oozie.action.hadoop.SqoopMain.runSqoopJob(SqoopMain.java:197)
    at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:179)
    at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:58)
    at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:48)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:239)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)

我的workflow.xml是:

<workflow-app name="${jobName}" xmlns="uri:oozie:workflow:0.1">
    <start to="sqoop-export" />
    <action name="sqoop-export">
        <sqoop xmlns="uri:oozie:sqoop-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <configuration>
                <property>
                    <name>mapred.compress.map.output</name>
                    <value>true</value>
                </property>
                <property>
                    <name>oozie.action.sharelib.for.sqoop</name> 
                    <value>sqoop,hive,hcatalog</value> 
                </property>
                <property>
                    <name>oozie.sqoop.log.level</name> 
                    <value>${debugLevel}</value> 
                </property>
                <property>
                    <name>mapred.reduce.tasks</name> 
                    <value>1</value> 
                </property>
                <property>
                    <name>hive.metastore.uris</name> 
                    <value>thrift://****:9083</value> 
                </property>
                <property>
                  <name>hive.metastore.warehouse.dir</name>
                  <value>/apps/hive/warehouse</value>
                </property>
            </configuration>
            <command>export --hcatalog-database modeling_reporting --hcatalog-table fact_kpi_da20 --table tmp_fact_kpi_da20 --connect jdbc:sqlserver://****.database.windows.net:1433;databaseName=****;user=****;password=****
            </command>
        </sqoop>
        <ok to="end"/>
        <error to="sqoop-load-fail"/>
    </action>
    <kill name="sqoop-load-fail">
        <message>Sqoop export failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <end name="end" />
</workflow-app>

我的job.properties包括:

oozie.use.system.libpath=true
oozie.wf.application.path=/user/abc

我运行作业时使用:

oozie job -config job.properties -run

其他日志显示作业能够连接到我的目标表,并验证我的列是否匹配:

7222 [main] DEBUG org.apache.sqoop.orm.CompilationManager  - Finished writing jar file /tmp/sqoop-yarn/compile/24e897ef3439fabb89090a4dbe4c9be1/tmp_fact_kpi_da20.jar
7222 [main] DEBUG org.apache.sqoop.orm.CompilationManager  - Finished writing jar file /tmp/sqoop-yarn/compile/24e897ef3439fabb89090a4dbe4c9be1/tmp_fact_kpi_da20.jar
7235 [main] INFO  org.apache.sqoop.mapreduce.ExportJobBase  - Beginning export of tmp_fact_kpi_da20
7235 [main] INFO  org.apache.sqoop.mapreduce.ExportJobBase  - Beginning export of tmp_fact_kpi_da20
7235 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
7240 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.jar is deprecated. Instead, use mapreduce.job.jar
7240 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
7240 [main] INFO  org.apache.sqoop.mapreduce.ExportJobBase  - Configuring HCatalog for export job
7240 [main] INFO  org.apache.sqoop.mapreduce.ExportJobBase  - Configuring HCatalog for export job
7257 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Configuring HCatalog specific details for job
7257 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Configuring HCatalog specific details for job
7493 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Execute getColumnInfoRawQuery : SELECT t.* FROM [tmp_fact_kpi_da20] AS t WHERE 1=0
7493 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Execute getColumnInfoRawQuery : SELECT t.* FROM [tmp_fact_kpi_da20] AS t WHERE 1=0
7493 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Using fetchSize for next query: 1000
7493 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Using fetchSize for next query: 1000
7493 [main] INFO  org.apache.sqoop.manager.SqlManager  - Executing SQL statement: SELECT t.* FROM [tmp_fact_kpi_da20] AS t WHERE 1=0
7493 [main] INFO  org.apache.sqoop.manager.SqlManager  - Executing SQL statement: SELECT t.* FROM [tmp_fact_kpi_da20] AS t WHERE 1=0
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventdate of type [-9, 10, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventdate of type [-9, 10, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column clientregion of type [-9, 4, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column clientregion of type [-9, 4, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column clientjourney of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column clientjourney of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventtype of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventtype of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventreason of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventreason of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column feature of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column feature of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column customerdevice of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column customerdevice of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column customerbrowser of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column customerbrowser of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column customercountryiso2 of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column customercountryiso2 of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column clientcurrencyiso3 of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column clientcurrencyiso3 of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventcount of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column eventcount of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column uniqueeventcount of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column uniqueeventcount of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column sales of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column sales of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column salesvalue of type [3, 38, 2]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column salesvalue of type [3, 38, 2]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column salesvaluegbp of type [3, 38, 2]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column salesvaluegbp of type [3, 38, 2]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column started_customersurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column started_customersurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column completed_customersurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column completed_customersurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column started_emailsubscriptions of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column started_emailsubscriptions of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column completed_emailsubscriptions of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column completed_emailsubscriptions of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column started_problemsolversurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column started_problemsolversurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column completed_problemsolversurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column completed_problemsolversurveys of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column scenario of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column scenario of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column abtestgroup of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column abtestgroup of type [-9, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column abtestid of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column abtestid of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column abtestiscontrol of type [-7, 1, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column abtestiscontrol of type [-7, 1, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column appversion of type [12, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column appversion of type [12, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column agentid of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column agentid of type [-5, 19, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column pdate of type [12, 50, 0]
7582 [main] DEBUG org.apache.sqoop.manager.SqlManager  - Found column pdate of type [12, 50, 0]
7670 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Database column names projected : [eventdate, clientregion, clientjourney, eventtype, eventreason, feature, customerdevice, customerbrowser, customercountryiso2, clientcurrencyiso3, eventcount, uniqueeventcount, sales, salesvalue, salesvaluegbp, started_customersurveys, completed_customersurveys, started_emailsubscriptions, completed_emailsubscriptions, started_problemsolversurveys, completed_problemsolversurveys, scenario, abtestgroup, abtestid, abtestiscontrol, appversion, agentid, pdate]
7670 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Database column names projected : [eventdate, clientregion, clientjourney, eventtype, eventreason, feature, customerdevice, customerbrowser, customercountryiso2, clientcurrencyiso3, eventcount, uniqueeventcount, sales, salesvalue, salesvaluegbp, started_customersurveys, completed_customersurveys, started_emailsubscriptions, completed_emailsubscriptions, started_problemsolversurveys, completed_problemsolversurveys, scenario, abtestgroup, abtestid, abtestiscontrol, appversion, agentid, pdate]
7670 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Database column name - info map :
    started_customersurveys : [Type : -5,Precision : 19,Scale : 0]
    pdate : [Type : 12,Precision : 50,Scale : 0]
    uniqueeventcount : [Type : -5,Precision : 19,Scale : 0]
    sales : [Type : -5,Precision : 19,Scale : 0]
    customerbrowser : [Type : -9,Precision : 50,Scale : 0]
    salesvalue : [Type : 3,Precision : 38,Scale : 2]
    abtestiscontrol : [Type : -7,Precision : 1,Scale : 0]
    feature : [Type : -9,Precision : 50,Scale : 0]
    scenario : [Type : -9,Precision : 50,Scale : 0]
    clientregion : [Type : -9,Precision : 4,Scale : 0]
    eventcount : [Type : -5,Precision : 19,Scale : 0]
    customercountryiso2 : [Type : -9,Precision : 50,Scale : 0]
    completed_emailsubscriptions : [Type : -5,Precision : 19,Scale : 0]
    salesvaluegbp : [Type : 3,Precision : 38,Scale : 2]
    abtestid : [Type : -5,Precision : 19,Scale : 0]
    agentid : [Type : -5,Precision : 19,Scale : 0]
    started_emailsubscriptions : [Type : -5,Precision : 19,Scale : 0]
    completed_problemsolversurveys : [Type : -5,Precision : 19,Scale : 0]
    appversion : [Type : 12,Precision : 50,Scale : 0]
    customerdevice : [Type : -9,Precision : 50,Scale : 0]
    clientjourney : [Type : -9,Precision : 50,Scale : 0]
    eventdate : [Type : -9,Precision : 10,Scale : 0]
    eventreason : [Type : -9,Precision : 50,Scale : 0]
    abtestgroup : [Type : -9,Precision : 50,Scale : 0]
    clientcurrencyiso3 : [Type : -9,Precision : 50,Scale : 0]
    completed_customersurveys : [Type : -5,Precision : 19,Scale : 0]
    started_problemsolversurveys : [Type : -5,Precision : 19,Scale : 0]
    eventtype : [Type : -9,Precision : 50,Scale : 0]

7670 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Database column name - info map :
    started_customersurveys : [Type : -5,Precision : 19,Scale : 0]
    pdate : [Type : 12,Precision : 50,Scale : 0]
    uniqueeventcount : [Type : -5,Precision : 19,Scale : 0]
    sales : [Type : -5,Precision : 19,Scale : 0]
    customerbrowser : [Type : -9,Precision : 50,Scale : 0]
    salesvalue : [Type : 3,Precision : 38,Scale : 2]
    abtestiscontrol : [Type : -7,Precision : 1,Scale : 0]
    feature : [Type : -9,Precision : 50,Scale : 0]
    scenario : [Type : -9,Precision : 50,Scale : 0]
    clientregion : [Type : -9,Precision : 4,Scale : 0]
    eventcount : [Type : -5,Precision : 19,Scale : 0]
    customercountryiso2 : [Type : -9,Precision : 50,Scale : 0]
    completed_emailsubscriptions : [Type : -5,Precision : 19,Scale : 0]
    salesvaluegbp : [Type : 3,Precision : 38,Scale : 2]
    abtestid : [Type : -5,Precision : 19,Scale : 0]
    agentid : [Type : -5,Precision : 19,Scale : 0]
    started_emailsubscriptions : [Type : -5,Precision : 19,Scale : 0]
    completed_problemsolversurveys : [Type : -5,Precision : 19,Scale : 0]
    appversion : [Type : 12,Precision : 50,Scale : 0]
    customerdevice : [Type : -9,Precision : 50,Scale : 0]
    clientjourney : [Type : -9,Precision : 50,Scale : 0]
    eventdate : [Type : -9,Precision : 10,Scale : 0]
    eventreason : [Type : -9,Precision : 50,Scale : 0]
    abtestgroup : [Type : -9,Precision : 50,Scale : 0]
    clientcurrencyiso3 : [Type : -9,Precision : 50,Scale : 0]
    completed_customersurveys : [Type : -5,Precision : 19,Scale : 0]
    started_problemsolversurveys : [Type : -5,Precision : 19,Scale : 0]
    eventtype : [Type : -9,Precision : 50,Scale : 0]

7834 [main] INFO  org.apache.hive.hcatalog.common.HiveClientCache  - Initializing cache: eviction-timeout=120 initial-capacity=50 maximum-capacity=50
7872 [main] INFO  hive.metastore  - Trying to connect to metastore with URI thrift://d-u2-prcs-sv-01.veproduction.dom:9083
7917 [main] INFO  hive.metastore  - Connected to metastore.
10113 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog full table schema fields = [eventdate, clientregion, clientjourney, eventtype, eventreason, feature, customerdevice, customerbrowser, customercountryiso2, clientcurrencyiso3, eventcount, uniqueeventcount, sales, salesvalue, salesvaluegbp, started_customersurveys, completed_customersurveys, started_emailsubscriptions, completed_emailsubscriptions, started_problemsolversurveys, completed_problemsolversurveys, scenario, abtestgroup, abtestid, abtestiscontrol, appversion, agentid, pdate]
10113 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog full table schema fields = [eventdate, clientregion, clientjourney, eventtype, eventreason, feature, customerdevice, customerbrowser, customercountryiso2, clientcurrencyiso3, eventcount, uniqueeventcount, sales, salesvalue, salesvaluegbp, started_customersurveys, completed_customersurveys, started_emailsubscriptions, completed_emailsubscriptions, started_problemsolversurveys, completed_problemsolversurveys, scenario, abtestgroup, abtestid, abtestiscontrol, appversion, agentid, pdate]
10849 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog table partitioning key fields = [pdate]
10849 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog table partitioning key fields = [pdate]
10849 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog projected schema fields = [eventdate, clientregion, clientjourney, eventtype, eventreason, feature, customerdevice, customerbrowser, customercountryiso2, clientcurrencyiso3, eventcount, uniqueeventcount, sales, salesvalue, salesvaluegbp, started_customersurveys, completed_customersurveys, started_emailsubscriptions, completed_emailsubscriptions, started_problemsolversurveys, completed_problemsolversurveys, scenario, abtestgroup, abtestid, abtestiscontrol, appversion, agentid, pdate]
10849 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog projected schema fields = [eventdate, clientregion, clientjourney, eventtype, eventreason, feature, customerdevice, customerbrowser, customercountryiso2, clientcurrencyiso3, eventcount, uniqueeventcount, sales, salesvalue, salesvaluegbp, started_customersurveys, completed_customersurveys, started_emailsubscriptions, completed_emailsubscriptions, started_problemsolversurveys, completed_problemsolversurveys, scenario, abtestgroup, abtestid, abtestiscontrol, appversion, agentid, pdate]
10889 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog job : Hive Home = /usr/lib/hive
10889 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog job : Hive Home = /usr/lib/hive
10889 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog job:  HCatalog Home = /usr/lib/hcatalog
10889 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - HCatalog job:  HCatalog Home = /usr/lib/hcatalog
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hcatalog/share/hcatalog to distributed cache
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hcatalog/share/hcatalog to distributed cache
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hcatalog/share/hcatalog to add to distributed cache for hcatalog job
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hcatalog/share/hcatalog to add to distributed cache for hcatalog job
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hcatalog/lib to distributed cache
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hcatalog/lib to distributed cache
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hcatalog/lib to add to distributed cache for hcatalog job
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hcatalog/lib to add to distributed cache for hcatalog job
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hive/lib to distributed cache
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hive/lib to distributed cache
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hive/lib to add to distributed cache for hcatalog job
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hive/lib to add to distributed cache for hcatalog job
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hcatalog/share/hcatalog/storage-handlers to distributed cache (recursively)
10920 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Adding jar files under /usr/lib/hcatalog/share/hcatalog/storage-handlers to distributed cache (recursively)
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hcatalog/share/hcatalog/storage-handlers to add to distributed cache for hcatalog job
10920 [main] WARN  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - No files under /usr/lib/hcatalog/share/hcatalog/storage-handlers to add to distributed cache for hcatalog job
10921 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Using InputFormat: class org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat
10921 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Using InputFormat: class org.apache.sqoop.mapreduce.hcat.SqoopHCatExportFormat
10921 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Configuring HCatalog for export job
10921 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Configuring HCatalog for export job
10921 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Ignoring configuration request for HCatalog info
10921 [main] INFO  org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities  - Ignoring configuration request for HCatalog info
11112 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
11112 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
11112 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation  - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
11113 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/filecache/14417/sqoop-1.4.6.2.6.2.0-205.jar
11113 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/filecache/14417/sqoop-1.4.6.2.6.2.0-205.jar
11114 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/usercache/louiscronin/filecache/1096/mssql-jdbc-8.2.2.jre8.jar
11114 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/usercache/louiscronin/filecache/1096/mssql-jdbc-8.2.2.jre8.jar
11115 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/filecache/14417/sqoop-1.4.6.2.6.2.0-205.jar
11115 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/filecache/14417/sqoop-1.4.6.2.6.2.0-205.jar
11116 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/filecache/14417/sqoop-1.4.6.2.6.2.0-205.jar
11116 [main] DEBUG org.apache.sqoop.mapreduce.JobBase  - Adding to job classpath: file:/mnt/resource/hadoop/yarn/local/filecache/14417/sqoop-1.4.6.2.6.2.0-205.jar
11116 [main] WARN  org.apache.sqoop.mapreduce.JobBase  - SQOOP_HOME is unset. May not be able to find all job dependencies.
11116 [main] WARN  org.apache.sqoop.mapreduce.JobBase  - SQOOP_HOME is unset. May not be able to find all job dependencies.
11210 [main] INFO  org.apache.hadoop.yarn.client.AHSProxy  - Connecting to Application History server at d-u2-prcs-nm-03.veproduction.dom/172.28.50.22:10200
11330 [main] INFO  org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider  - Looking for the active RM in [rm1, rm2]...
11336 [main] INFO  org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider  - Found active RM [rm2]
11518 [main] INFO  org.apache.hadoop.mapreduce.JobSubmitter  - Cleaning up the staging area /user/louiscronin/.staging/job_1612961662367_2162
11546 [main] WARN  org.apache.hadoop.fs.azure.AzureFileSystemThreadPoolExecutor  - Disabling threads for Delete operation as thread count 0 is <= 1
11554 [main] INFO  org.apache.hadoop.fs.azure.AzureFileSystemThreadPoolExecutor  - Time taken for Delete operation is: 9 ms with threads: 0
11603 [main] ERROR org.apache.sqoop.Sqoop  - Got exception running Sqoop: java.lang.IllegalArgumentException: Can not create a Path from an empty string
11603 [main] ERROR org.apache.sqoop.Sqoop  - Got exception running Sqoop: java.lang.IllegalArgumentException: Can not create a Path from an empty string

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题