在bigtop hadoop中没有出现hiveserver2

0vvn1miw  于 2021-05-31  发布在  Hadoop
关注(0)|答案(0)|浏览(310)

我们正在用hive和hbase+kerberos构建一个普通的hadoop2.7.3集群。我们使用hadoop中的bigtop repo来简化它。
部署脚本成功地安装了配置单元和组件,但即使我们运行了metastore和hiveserver,
它没有使用10000端口,
我们无法连接到直线。
没有错误
它甚至没有创建hiveserver2.log文件。
ps-ef | grep配置单元显示以下输出

  1. hive 9043 1 2 10:57 ? 00:00:23 /usr/lib/jvm/java-openjdk/bin/java -Xmx256m -Djava.security.krb5.conf=/etc/krb5.conf -Dhadoop.log.dir=/usr/lib/hadoop/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/usr/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /usr/lib/hive/lib/hive-service-1.2.1.jar org.apache.hadoop.hive.metastore.HiveMetaStore
  2. hive 9751 1 2 11:04 ? 00:00:11 /usr/lib/jvm/java-openjdk/bin/java -Xmx256m -Djava.security.krb5.conf=/etc/krb5.conf -Dhadoop.log.dir=/usr/lib/hadoop/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/usr/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /usr/lib/hive/lib/hive-service-1.2.1.jar org.apache.hive.service.server.HiveServer2
  3. root 10285 7469 0 11:13 pts/1 00:00:00 grep hive

与直线的连接

  1. [root@wnode55 ~]# beeline -u 'jdbc:hive2://wnode55.domain_name.com:10000/default;principal=hive/wnode55.domain_name.com@domain_name.COM'
  2. ls: cannot access /usr/lib/spark/lib/spark-assembly-*.jar: No such file or directory
  3. Connecting to jdbc:hive2://wnode55.domain_name.com:10000/default;principal=hive/wnode55.domain_name.com@domain_name.COM
  4. Error: Could not open client transport with JDBC Uri: jdbc:hive2://wnode55.domain_name.com:10000/default;principal=hive/wnode55.domain_name.com@domain_name.COM: java.net.ConnectException: Connection refused (Connection refused) (state=08S01,code=0)
  5. Beeline version 1.2.1 by Apache Hive
  6. 0: jdbc:hive2://wnode55.domain_name.com:10000 (closed)>

配置单元站点.xml

  1. [root@wnode55 ~]# cat /etc/hive/conf/hive-site.xml
  2. <?xml version="1.0"?>
  3. <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
  4. <!-- Licensed to the Apache Software Foundation (ASF) under one or more -->
  5. <!-- contributor license agreements. See the NOTICE file distributed with -->
  6. <!-- this work for additional information regarding copyright ownership. -->
  7. <!-- The ASF licenses this file to You under the Apache License, Version 2.0 -->
  8. <!-- (the "License"); you may not use this file except in compliance with -->
  9. <!-- the License. You may obtain a copy of the License at -->
  10. <!-- -->
  11. <!-- http://www.apache.org/licenses/LICENSE-2.0 -->
  12. <!-- -->
  13. <!-- Unless required by applicable law or agreed to in writing, software -->
  14. <!-- distributed under the License is distributed on an "AS IS" BASIS, -->
  15. <!-- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -->
  16. <!-- See the License for the specific language governing permissions and -->
  17. <!-- limitations under the License. -->
  18. <configuration>
  19. <!-- Hive Configuration can either be stored in this file or in the hadoop configuration files -->
  20. <!-- that are implied by Hadoop setup variables. -->
  21. <!-- Aside from Hadoop setup variables - this file is provided as a convenience so that Hive -->
  22. <!-- users do not have to edit hadoop configuration files (that may be managed as a centralized -->
  23. <!-- resource). -->
  24. <!-- Hive Execution Parameters -->
  25. <property>
  26. <name>hbase.zookeeper.quorum</name>
  27. <value>wnode55.domain_name.com</value>
  28. <description>http://wiki.apache.org/hadoop/Hive/HBaseIntegration</description>
  29. </property>
  30. <property>
  31. <name>hive.execution.engine</name>
  32. <value>mr</value>
  33. </property>
  34. <property>
  35. <name>javax.jdo.option.ConnectionURL</name>
  36. <value>jdbc:derby:;databaseName=/var/lib/hive/metastore/metastore_db;create=true</value>
  37. <description>JDBC connect string for a JDBC metastore</description>
  38. </property>
  39. <property>
  40. <name>javax.jdo.option.ConnectionDriverName</name>
  41. <value>org.apache.derby.jdbc.EmbeddedDriver</value>
  42. <description>Driver class name for a JDBC metastore</description>
  43. </property>
  44. <property>
  45. <name>hive.hwi.war.file</name>
  46. <value>/usr/lib/hive/lib/hive-hwi.war</value>
  47. <description>This is the WAR file with the jsp content for Hive Web Interface</description>
  48. </property>
  49. <property>
  50. <name>hive.server2.allow.user.substitution</name>
  51. <value>true</value>
  52. </property>
  53. <property>
  54. <name>hive.server2.enable.doAs</name>
  55. <value>true</value>
  56. </property>
  57. <property>
  58. <name>hive.server2.thrift.port</name>
  59. <value>10000</value>
  60. </property>
  61. <property>
  62. <name>hive.server2.thrift.http.port</name>
  63. <value>10001</value>
  64. </property>
  65. <property>
  66. <name>hive.metastore.uris</name>
  67. <value>thrift:/wnode55.domain_name.com:9083</value>
  68. </property>
  69. <property>
  70. <name>hive.security.metastore.authorization.manager</name>
  71. <value>org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider</value>
  72. </property>
  73. <property>
  74. <name>hive.server2.authentication</name>
  75. <value>KERBEROS</value>
  76. </property>
  77. <property>
  78. <name>hive.server2.authentication.kerberos.principal</name>
  79. <value>hive/_HOST@domain_name.COM</value>
  80. </property>
  81. <property>
  82. <name>hive.server2.authentication.kerberos.keytab</name>
  83. <value>/etc/hadoop/conf/hive.keytab</value>
  84. </property>
  85. </configuration>

任何帮助都将不胜感激。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题