使用importtsv将数据加载到hbase会导致错误

5anewei6  于 2021-06-04  发布在  Hadoop
关注(0)|答案(1)|浏览(418)

我正在尝试使用importtsv工具将csv文件中的数据加载到hbase中。我设置了一个由3台机器组成的集群。这是我的hbase-site.xml文件

<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://ec2-54-190-103-64.us-west-2.compute.amazonaws.com:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
 <property>
   <name>hbase.zookeeper.quorum</name>
   <value>ec2-54-203-95-235.us-west-2.compute.amazonaws.com</value>
  </property>
 <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>

  <property>
      <name>hbase.zookeeper.property.clientPort</name>
      <value>2222</value>
   </property>
   <property>
   <name>hbase.zookeeper.property.dataDir</name>
   <value>/home/ubuntu/zookeeper</value>
   <description>Property from ZooKeeper's config zoo.cfg.
   The directory where the snapshot is stored.
    </description>
 </property>
 </configuration>

当我开始运行jps时。在主节点下,我看到了hmaster,在datanodes下,我看到了hquorumpeer和hregionserver,当我尝试加载数据时,我得到了以下错误

INFO zookeeper.ClientCnxn: Opening socket connection to server       localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
 14/08/11 07:41:28 WARN zookeeper.ClientCnxn: Session 0x0 for server null,    unexpected     error, closing socket connection and attempting reconnect
  java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at   org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   14/08/11 07:41:28 WARN zookeeper.RecoverableZooKeeper: Possibly transient   ZooKeeper    exception: org.apache.zookeeper.KeeperException$ConnectionLossException:    KeeperErrorCode = ConnectionLoss for /hbase
 14/08/11 07:41:28 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
  14/08/11 07:41:29 INFO zookeeper.ClientCnxn: Opening socket connection to server   localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

不知道Zookeeper有什么问题。提前谢谢

8hhllhi2

8hhllhi21#

您需要在hbase-site.xml文件(主文件和从文件)中添加以下属性

<property>
 <name>hbase.zookeeper.property.maxClientCnxns</name>
 <value>1000</value>
</property>

相关问题