无法使用aws数据管道从配置单元读取数据

4si2a6ki  于 2021-07-13  发布在  Hive
关注(0)|答案(0)|浏览(337)

使用aws数据管道,使用驱动程序hivejdbc4.jar并将类名指定为com.amazon.hive.jdbc4.hs1driver,并尝试连接配置单元表。
连接成功,但无法检索数据。
下面是错误:从s3://storage for hive/drivers/hivejdbc4.jar 07 apr 2021 10:36:04使用驱动程序连接,399[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.database.connectionfactory:已创建连接jdbc:hive2网址:ec2-54-170-146-194.eu-west-1.compute.amazonaws。com:10000/demo 2021年4月7日10:36:04,415[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.connector.staging.s3helper:$decorating s3 client with region 07 apr 2021 10:36:04,423[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.datapipeline.factory.s3clientfactory:返回该地区缓存的amazon3client[eu-west-1]2021年4月7日10:36:04,424[警告](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.s3.amazon3client:没有为流数据指定内容长度。流内容将在内存中缓冲,并可能导致内存不足错误。2021年4月7日10:36:04548[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.connector.s3.s3outputconnector:没有要提交的记录null 2021年4月7日10:36:04,550[信息](heartbeatservice-df-081576635eae6fcf0ole-@copyactivityid_mnq7z_2021-04-07t10:31:47\u尝试=1)amazonaws.datapipeline.taskrunner.heartbeatservice:heartbeatservice线程正在关闭df-081576635eae6fcf0ole-@copyactivityid_mnq7z_2021-04-07t10:31:47\u尝试=1 07 apr 2021 10:36:04,550[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.taskrunner.heartbeatservice:已完成等待心跳线程@defaultcopyactivity1\u 2021-04-07t10:31:47\u attempt=1 07 apr 2021 10:36:04,551[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.taskrunner.taskpoller:work copyactivity花费0:3完成2021年4月7日10:36:04,607[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.logpusher.uploader:上载到s3://storelogdemo/df-081576635eae6fcf0ole/copyactivityid\u mnq7z/@copyactivityid\u mnq7z\u 2021-04-07t10:31:47/@copyactivityid\u mnq7z\u 2021-04-07t10:31:47\u attempt=1/活动。log@000000000000000-000000000004687.gzsize:924 07 2021年4月10:36:04,626[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.datapipeline.factory.s3clientfactory:返回该地区缓存的amazon3client[eu-west-1]2021年4月7日10:36:04,697[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.datapipeline.factory.s3clientfactory:返回该地区缓存的amazon3client[eu-west-1]2021年4月7日10:36:04,731[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.datapipeline.factory.s3clientfactory:返回该地区缓存的amazon3client[eu-west-1]2021年4月7日10:36:04,732[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.logpusher.uploader:合并s3://storelogdemo/df-081576635eae6fcf0ole/copyactivityid\u mnq7z/@copyactivityid\u mnq7z\u 2021-04-07t10:31:47/@copyactivityid\u mnq7z\u 2021-04-07t10:31:47\u attempt=1/活动。log@000000000000000-000000000004687.gz 2021年4月7日10:36:04,775[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.logpusher.uploader:upload s3://storelogdemo/df-081576635eae6fcf0ole/copyactivityid\u mnq7z/@copyactivityid\u mnq7z\u 2021-04-07t10:31:47/@copyactivityid\u mnq7z\u 2021年4月7日10:36:04,783[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.datapipeline.factory.s3clientfactory:返回该地区缓存的amazon3client[eu-west-1]2021年4月7日10:36:04,829[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)private.com.amazonaws.services.datapipeline.factory.s3clientfactory:返回该地区缓存的amazon3client[eu-west-1]2021年4月7日10:36:04,829[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0)amazonaws.datapipeline.logpusher.uploader:deleting:df-081576635eae6fcf0ole/copyactivityid_mnq7z/@copyactivityid_mnq7z_2021-04-07t10:31:47/@copyactivityid\u mnq7z\u 2021-04-07t10:31:47\u attempt=1/活动。log@000000000000000-000000000004687.gz 4月7日2021年10:36:04865信息在amazonaws.datapipeline.activity.copyactivity.runactivity(copyactivity。java:22)在amazonaws.datapipeline.objects.abstractactivity.run(abstractactivity。java:16)在amazonaws.datapipeline.taskrunner.taskpoller.executemoterunner(taskpoller。java:136)在amazonaws.datapipeline.taskrunner.taskpoller.executetask(taskpoller。java:105)在amazonaws.datapipeline.taskrunner.taskpoller$1.run(taskpoller。java:81)在private.com.amazonaws.services.datapipeline.poller.pollworker.executework(pollworker。java:76)在private.com.amazonaws.services.datapipeline.poller.pollworker.run(pollworker。java:53)在java.lang.thread.run(线程。java:748)原因:java.lang.nullpointerexception atamazonaws.datapipeline.connector.sqldatanode.preparestatement(sqldatanode。java:171)在amazonaws.datapipeline.connector.sqlinputconnector.open(sqlinputconnector。java:48)在amazonaws.datapipeline.connector.sqlinputconnector.(sqlinputconnector。java:25)在amazonaws.datapipeline.connector.sqldatanode.getinputconnector(sqldatanode。java:79)在amazonaws.datapipeline.activity.copy.singlethreadedcopyactivity.processall(singlethreadedcopyactivity)。java:47) ... 9更多2021年4月7日10:36:05654[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-1)amazonaws.datapipeline.taskrunner.taskpoller:请求远程工作:resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:2021年4月7日31:47 10:37:06,331[信息](taskrunnerservice-resource:df-081576635eae6fcf0ole_@resourceid_o4ipa_2021-04-07t10:31:47-0

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题