org.apache.hadoop.yarn.API.ApplicationClientProtocolPB is unauthorized错误?

nbysray5  于 2023-08-03  发布在  Hadoop
关注(0)|答案(1)|浏览(240)

我对Hadoop进行了Kerberized
我在core-site.xml中设置了这个

<property>
    <name>hadoop.proxyuser.hue.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.hue.groups</name>
    <value>*</value>
  </property>

字符串
而且我已经apache livy向spark提交了作业
我想通过apache livy发送请求。
在我的livy.conf里

livy.impersonation.enabled = true


在我的hue.ini

[spark]
livy_server_host=myhost
livy_server_port=8998
security_enabled=true



 [[[sparksql]]]
   name=SparkSql
   interface=livy


当我在hue中打开spark sql选项卡时,它在apache livy中给出了这个错误

INFO client.ConfiguredRMFailoverProxyProvider: Failing over to <rm_1> 
INFO retry.RetryInvocationHandler: Exception while invoking getNewApplication of class ApplicationClientProtocolPBClientImpl over <rm_1> after XX fail over attempts. Trying to fail over immediately. 
INFO client.ConfiguredRMFailoverProxyProvider: Failing over to <rm_2>
WARN ipc.Client: Failed to connect to server: <rm_server>: retries get failed due to exceeded maximum allowed retries number: 0 
java.net.ConnectException: Connection refused


并且在resourcemanager日志中我得到这个错误

INFO org.apache.hadoop.ipc.Server: Connection from <IP>:<PORT>
 for protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB 
is unauthorized for user myproxy_user (auth:PROXY) via hue/myHueHost@MY.DOMAIN.NET (auth:KERBEROS)


事情是我设置主机和组 * 在核心网站,但它仍然给出了这个错误

pbwdgjma

pbwdgjma1#

这很奇怪,因为当我用hive更改Livy LaunchKeyTab和Principal时,它可以正常工作(我在核心站点XML中也将Hive定义为代理用户)
仍然不知道为什么色调keytab不工作

相关问题