尝试使用pyspark连接到phoenix表并得到以下错误

ni65a41a  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(300)

读取phoenix表的命令:sql\u sc.read.format(“org.apache.phoenix.spark”).option(“table”,tablename).option(“zkurl”,“10.0.11.21:2181”).load()错误:traceback(最近一次调用):file“/bdaas/exe/healthcare/hl7visualization.py”,第42行,在hl7=phoenix\u sparkdata(spark\u app='hl7-app',spark\u master='local',table\u name='hl7table\u v2\u 3')file“/bdaas/exe/healthcare/hl7visualization.py”,第19行,在init self.dataframe=self.phoenix\u getdataframe(table\u name)file“/bdaas/exe/healthcare/hl7visualization.py”中,phoenix\u getdataframe df=self.sql\u sc.read.format(“org.apache.phoenix.spark”).option(“table”,tablename).option(“zkurl”,“10.0.11.21:2181”).load()文件“/usr/hdp/2.4.2.0-258/spark/python/lib/pyspark.zip/pyspark/sql/readwriter.py”,第139行,在加载文件“/usr/hdp/2.4.2.0-258/spark/python/lib/py4j-0.9-src.zip/py4j/javaïgateway.py”第813行,在调用文件“/usr/hdp/2.4.2.0-258/spark/python/lib/pyspark.zip/pyspark/sql/utils.py”第45行,在deco文件“/usr/hdp/2.4.2.0-258/spark/python/lib/py4j-0.9-src.zip/py4j/protocol.py”第308行的get\u return\u value py4j.protocol.py4jjavaerror:调用o43.load时出错:java.lang.nosuchmethoderror:com.fasterxml.jackson.module.scala.deser.bigdecimaldeserializer$.handledtype()ljava/lang/class;在com.fasterxml.jackson.module.scala.deser.numberderserializers$(scalanumberderserializersmodule。scala:49)在com.fasterxml.jackson.module.scala.deser.numberderserializers$(scalanumberderserializersmodule.scala)在com.fasterxml.jackson.module.scala.deser.scalanumberderserializersmodule$class.$init$(scalanumberderserializersmodule)。scala:61)在com.fasterxml.jackson.module.scala.defaultscalamodule.(默认Scalamodule。scala:19)在com.fasterxml.jackson.module.scala.defaultscalamodule$(defaultscalamodule。scala:35)在com.fasterxml.jackson.module.scala.defaultscalamodule$(defaultscalamodule.scala)org.apache.spark.rdd.rddoperationscope$(rddoperationscope)上。scala:81)在org.apache.spark.rdd.rddoperationscope$(rddoperationscope.scala)位于org.apache.spark.sparkcontext.withscope(sparkcontext)。scala:714)在org.apache.spark.sparkcontext.newapihadooprdd(sparkcontext。scala:1152)在org.apache.phoenix.spark.phoenixrdd。scala:46)在org.apache.phoenix.spark.phoenixrelation.schema(phoenixrelation。scala:50)在org.apache.spark.sql.execution.datasources.logicalrelation.(逻辑关系。scala:37)位于org.apache.spark.sql.dataframereader.load(dataframereader。scala:125)在sun.reflect.nativemethodaccessorimpl.invoke0(本机方法)在sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl)。java:57)在sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl。java:43)在java.lang.reflect.method.invoke(方法。java:606)在py4j.reflection.methodinvoker.invoke(methodinvoker。java:231)在py4j.reflection.reflectionengine.invoke(reflectionengine。java:381)在py4j.gateway.invoke(gateway。java:259)在py4j.commands.abstractcommand.invokemethod(abstractcommand。java:133)在py4j.commands.callcommand.execute(callcommand。java:79)在py4j.gatewayconnection.run(网关连接。java:209)在java.lang.thread.run(线程。java:745)

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题