pyspark readstream显示器框架不工作

fae0ux8s  于 2023-10-15  发布在  Spark
关注(0)|答案(1)|浏览(84)

我已经在数据库中使用自动加载器加载了三角洲青铜表。
现在我想读取这个表并显示出来。但我不是我得到的错误时,display(df)运行。
我的代码:

df= spark.readStream.format("delta") \
  .option("readChangeFeed", "true") \
  .table("mdp_prd.bronze.nrq_customerassetproperty_autoloader_nodups")

错误代码:
Py4JError:调用z:com.databricks.backend.daemon.driver.DisplayHelper.getStreamName时出错。Trace:10.00.000.000.000.0000.0000.0000.0000.00000.0000.0000.00000.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000方法public static java. lang. String com. databricks. backend. daemon. driver. DisplayHelper. getStreamName()未列入类com. databricks. backend. daemon. driver. DisplayHelper的白名单,

py4j.security.WhitelistingPy4JSecurityManager.checkCall(WhitelistingPy4JSecurityManager.java:473)
    at py4j.Gateway.invoke(Gateway.java:305)
    at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
    at py4j.commands.CallCommand.execute(CallCommand.java:79)
    at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:195)
    at py4j.ClientServerConnection.run(ClientServerConnection.java:115)
    at java.lang.Thread.run(Thread.java:750)
axr492tv

axr492tv1#

我已经改变了集群在databricks从共享到单用户和它的工作

相关问题