Apache Spark 无法在Zeppelin笔记本上使用Python

siotufzp  于 2023-06-24  发布在  Apache
关注(0)|答案(1)|浏览(155)

我刚刚安装了Zeppelin,所以我可以开始用Spark和AWS Glue做一些测试。我选择Python作为我的解释器。我首先在notebook中编写以下命令来测试它
%python print ("Hello World")
但是,当我尝试时,我得到以下错误:
org.apache.zeppelin.interpreter.InterpreterException: org.apache.zeppelin.interpreter.InterpreterException:无法在www.example.com(LazyOpenInterpreter.java:76)at org打开PythonInterpreter。Apache齐柏林飞艇口译员遥远RemoteInterpreterServer $InterpretJob。jobRun(RemoteInterpreterServer.java:844)at org.Apache飞艇翻译遥远RemoteInterpreterServer $InterpretJob。jobRun(RemoteInterpreterServer.java:752)at www.example.com(Job.java:172)at org。Apache飞艇调度程序。AbstractScheduler。runJob(AbstractScheduler.java:132)at org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42)at java. base/java。效用同时发生。ThreadPoolExecutor。runWorker(ThreadPoolExecutor.java:1144)。base/java。效用并发ThreadPoolExecutor $Worker.run(ThreadPoolExecutor.java:642)。base/java. lang.线程。run(Thread.java:1623)原因:org.apache.zeppelin.interpreter.LazyOpenInterpreter.open Fail to open PythonInterpreter at www.example.com(PythonInterpreter.java:123)at www.example.com(LazyOpenInterpreter.java:70)8更多原因:org.apache.zeppelin.scheduler.Job.run无法启动Python进程。org.apache.commons.exec.ExecuteException:执行失败(退出值:org.apache.zeppelin.python.PythonInterpreter.open由java.io.IOException引起:org.apache.zeppelin.interpreter.LazyOpenInterpreter.openerror = 2,No such file or directory)at org. apache. commons. exec. DefaultExecutor $www.example.com(DefaultExecutor.java:205)at java. base/java. lang. Thread. run(Thread.java:1623)原因:java.io.IOException:无法运行程序"python"(在目录"."中):error = 2,java中没有这样的文件或目录。base/java. lang。ProcessBuilder。在java中启动(ProcessBuilder.java:1140)。base/java. lang。ProcessBuilder。在java中启动(ProcessBuilder.java:1074)。base/java. lang。运行时间。exec(Runtime.java:647)at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61)at org.Apache公地执行DefaultExecutor。在org上启动(DefaultExecutor.java:279)。Apache公地执行DefaultExecutor。executeInternal(DefaultExecutor.java:336)at org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48)at org.Apache公地执行DefaultExecutor $www.example.com(DefaultExecutor.java:200)还有1个原因:java.io.IOException: error = 2,No such file or directory at java. base/java. lang. ProcessImpl. forkAndExec(Native Method)at java. base/java.lang.ProcessImpl.(ProcessImpl.java:319)at java. base/java. lang. ProcessImpl. start(ProcessImpl.java:249)at java. base/java. lang. ProcessBuilder. start(ProcessBuilder.java:1111)8 more Caused by java.io.IOException: Cannot run program "python" (in directory "."): error=2, No such file or directory) at org.apache.commons.exec.DefaultExecutor$1.run (DefaultExecutor.java:205) at java.base/java.lang.Thread.run(Thread.java:1623) Caused by: java.io.IOException: Cannot run program "python" (in directory "."): error=2, No such file or directory at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1140) at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1074) at java.base/java.lang.Runtime.exec(Runtime.java:647) at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61) at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336) at org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48) at org.apache.commons.exec.DefaultExecutor$1.run (DefaultExecutor.java:200) 1 more Caused by: java.io.IOException: error=2, No such file or directory at java.base/java.lang.ProcessImpl.forkAndExec(Native Method) at java.base/java.lang.ProcessImpl.(ProcessImpl.java:319) at java.base/java.lang.ProcessImpl.start(ProcessImpl.java:249) at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1111) 8 more
at org. apache. zeppelin. python. PythonInterpreter. createGatewayServerAndStartScript(PythonInterpreter.java:170)at www.example.com(PythonInterpreter.java:120)9 more org.apache.zeppelin.python.PythonInterpreter.open (PythonInterpreter.java:120) 9 more
我使用的是带有Apple M1芯片的MacBook Pro。我已经确认Python在我的终端上也可以工作。有没有什么我遗漏的东西阻止我在Zeppelin上使用python?
我检查了我的. zshrc配置,看看它是否有效:
/usr/bin/python3
export SPARK_HOME =/Users//Documents/Projects/spark/spark-3.1.3-bin-hadoop3. 2
我还尝试注销公司的VPN并重新启动终端。

atmip9wb

atmip9wb1#

算了,我刚想明白。我访问了Zeppelin的解释器部分,并将zeppelin.python配置更改为我安装了python的路径。

相关问题