org.apache.hadoop.yarn.API.ApplicationClientProtocolPB is unauthorized错误?

nbysray5  于 2023-08-03  发布在  Hadoop
关注(0)|答案(1)|浏览(290)

我对Hadoop进行了Kerberized
我在core-site.xml中设置了这个

  1. <property>
  2. <name>hadoop.proxyuser.hue.hosts</name>
  3. <value>*</value>
  4. </property>
  5. <property>
  6. <name>hadoop.proxyuser.hue.groups</name>
  7. <value>*</value>
  8. </property>

字符串
而且我已经apache livy向spark提交了作业
我想通过apache livy发送请求。
在我的livy.conf里

  1. livy.impersonation.enabled = true


在我的hue.ini

  1. [spark]
  2. livy_server_host=myhost
  3. livy_server_port=8998
  4. security_enabled=true
  5. [[[sparksql]]]
  6. name=SparkSql
  7. interface=livy


当我在hue中打开spark sql选项卡时,它在apache livy中给出了这个错误

  1. INFO client.ConfiguredRMFailoverProxyProvider: Failing over to <rm_1>
  2. INFO retry.RetryInvocationHandler: Exception while invoking getNewApplication of class ApplicationClientProtocolPBClientImpl over <rm_1> after XX fail over attempts. Trying to fail over immediately.
  3. INFO client.ConfiguredRMFailoverProxyProvider: Failing over to <rm_2>
  4. WARN ipc.Client: Failed to connect to server: <rm_server>: retries get failed due to exceeded maximum allowed retries number: 0
  5. java.net.ConnectException: Connection refused


并且在resourcemanager日志中我得到这个错误

  1. INFO org.apache.hadoop.ipc.Server: Connection from <IP>:<PORT>
  2. for protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB
  3. is unauthorized for user myproxy_user (auth:PROXY) via hue/myHueHost@MY.DOMAIN.NET (auth:KERBEROS)


事情是我设置主机和组 * 在核心网站,但它仍然给出了这个错误

pbwdgjma

pbwdgjma1#

这很奇怪,因为当我用hive更改Livy LaunchKeyTab和Principal时,它可以正常工作(我在核心站点XML中也将Hive定义为代理用户)
仍然不知道为什么色调keytab不工作

相关问题