访问mapr db表时出错

xfb7svmp  于 2021-06-01  发布在  Hadoop
关注(0)|答案(2)|浏览(448)

我在mapr fs 5.2.0上工作。我在尝试访问mapr db表时遇到问题。
这是我的密码：

  1. Configuration configuration = HBaseConfiguration.create();
  2. configuration.addResource("hbase-site.xml");    
  3. HTable table = new HTable(configuration,"/user/mapr/table1");

我的jar是：
commons-collections-3.2.2.jar
commons-configuration-1.6.jar
commons-lang-2.6.jar
commons-logging-1.2.jar
Guava-12.0.1.jar
hadoop-auth-2.7.0-mapr-1602.jar
hadoop-common-2.7.0-mapr-1602.jar
hbase-client-1.1.1-mapr-1602.jar
hbase-common-1.1.1-mapr-1602.jar
hbase-protocol-1.1.1-mapr-1602.jar
hive-exec-0.11.0.jar
hive-jdbc-0.11.0.jar
hive-metastore-0.11.0.jar
配置单元服务-0.11.0.jar
httpclient-4.5.2.jar
httpmime-4.5.2.jar文件
json-20080701.jar文件
libfb303-0.9.0.jar文件
libstrift-0.9.0.jar
日志4j-1.2.17.jar
maprfs-5.2.0-mapr.jar
mapr-hbase-5.2.0-mapr.jar
protobuf-java-3.1.0.jar
slf4j-api-1.7.7.jar
slf4j-log4j12-1.6.1.jar
zookeeper-3.4.5-mapr-1406.jar
我得到的错误是：

  1. 08/06/2017 17:15:57 DEBUG CLDBRpcCommonUtils:133 - init
  2. 08/06/2017 17:15:57 DEBUG JVMProperties:49 - Setting JVM property zookeeper.saslprovider to com.mapr.security.simplesasl.SimpleSaslProvider
  3. 08/06/2017 17:15:57 DEBUG JVMProperties:49 - Setting JVM property zookeeper.sasl.clientconfig to Client_simple
  4. 08/06/2017 17:15:57 DEBUG JVMProperties:49 - Setting JVM property java.security.auth.login.config to /opt/mapr/conf/mapr.login.conf
  5. 08/06/2017 17:15:57 DEBUG Configuration:2367 - Loaded org.apache.hadoop.conf.CoreDefaultProperties
  6. 08/06/2017 17:15:57 DEBUG Shell:321 - Failed to detect a valid hadoop home directory
  7. 08/06/2017 17:15:58 DEBUG Shell:397 - setsid exited with exit code 0
  8. 08/06/2017 17:15:58 DEBUG Configuration:2367 - Loaded org.apache.hadoop.conf.CoreDefaultProperties
  9. 08/06/2017 17:15:58 DEBUG Configuration:2367 - Loaded org.apache.hadoop.conf.CoreDefaultProperties
  10. 08/06/2017 17:15:58 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)])
  11. 08/06/2017 17:15:58 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)])
  12. 08/06/2017 17:15:58 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[GetGroups])
  13. 08/06/2017 17:15:58 DEBUG MetricsSystemImpl:232 - UgiMetrics, User and group related metrics
  14. 08/06/2017 17:15:58 DEBUG Configuration:2367 - Loaded org.apache.hadoop.conf.CoreDefaultProperties
  15. 08/06/2017 17:15:58 DEBUG UserGroupInformation:211 - HADOOP_SECURITY_AUTHENTICATION is set to: SIMPLE
  16. 08/06/2017 17:15:58 DEBUG UserGroupInformation:242 - Login configuration entry is hadoop_simple
  17. 08/06/2017 17:15:58 DEBUG UserGroupInformation:337 - authenticationMethod from JAAS configuration:SIMPLE
  18. 08/06/2017 17:15:58 DEBUG Configuration:2367 - Loaded org.apache.hadoop.conf.CoreDefaultProperties
  19. 08/06/2017 17:15:58 DEBUG Groups:301 -  Creating new Groups object
  20. 08/06/2017 17:15:58 DEBUG NativeCodeLoader:46 - Trying to load the custom-built native-hadoop library...
  21. 08/06/2017 17:15:58 DEBUG NativeCodeLoader:55 - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
  22. 08/06/2017 17:15:58 DEBUG NativeCodeLoader:56 - java.library.path=/opt/mapr/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
  23. 08/06/2017 17:15:58 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  24. 08/06/2017 17:15:58 DEBUG PerformanceAdvisory:41 - Falling back to shell based
  25. 08/06/2017 17:15:58 DEBUG JniBasedUnixGroupsMappingWithFallback:45 - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
  26. 08/06/2017 17:15:58 DEBUG Groups:112 - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
  27. 08/06/2017 17:15:58 DEBUG HadoopLoginModule:210 - Priority principal search list is [class javax.security.auth.kerberos.KerberosPrincipal]
  28. 08/06/2017 17:15:58 DEBUG HadoopLoginModule:212 - Additional principal search list is [class com.sun.security.auth.UnixPrincipal]
  29. 08/06/2017 17:15:58 DEBUG HadoopLoginModule:222 - hadoop login
  30. 08/06/2017 17:15:58 DEBUG HadoopLoginModule:132 - hadoop login commit
  31. 08/06/2017 17:15:58 DEBUG RpcAuthRegistry:84 - Added SIMPLE to registry.
  32. 08/06/2017 17:15:58 DEBUG RpcAuthRegistry:84 - Added KERBEROS to registry.
  33. 08/06/2017 17:15:58 DEBUG RpcAuthRegistry:84 - Added TOKEN to registry.
  34. 08/06/2017 17:15:58 DEBUG RpcAuthRegistry:84 - Added FAKE to registry.
  35. 08/06/2017 17:15:58 DEBUG UserGroupInformation:768 - Found no authentication principals in subject. Simple?
  36. 08/06/2017 17:15:58 DEBUG UserGroupInformation:754 - UGI loginUser:mapr (auth:SIMPLE)
  37. 08/06/2017 17:15:58 INFO  ConnectionFactory:272 - ConnectionFactory receives mapr.hbase.default.db(maprdb), set clusterType(MAPR_ONLY), hbase_admin_connect_at_construction(false)
  38. 08/06/2017 17:15:58 INFO  ConnectionFactory:277 - ConnectionFactory creates a maprdb connection!
  39. Is Master running? true
  40. 08/06/2017 17:15:58 DEBUG MapRHTable:87 - Init table /user/mapr/table1
  41. 08/06/2017 17:15:58 DEBUG MapRLoginHttpsClient:114 - Entering authenticate if needed.
  42. 08/06/2017 17:15:58 DEBUG MapRLoginHttpsClient:251 - Kerberos not configured for this cluster.
  43. 08/06/2017 17:15:58 DEBUG MapRLoginHttpsClient:131 - security appears to be off
  44. 08/06/2017 17:15:58 DEBUG MapRFileSystem:651 - User Info object initialized for user mapr with user ID 5000
  45. 08/06/2017 17:15:58 DEBUG Inode:25 - >Inode GetAttr: table: /user/mapr/table1, size: 2, chunksize: 0, fid: 2066.53132.14923640
  46. Exception : java.lang.RuntimeException: Error occurred while instantiating com.mapr.fs.hbase.HTableImpl11.
  47. ==> java.lang.NoSuchMethodError: com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.makeExtensionsImmutable()V.
  48. java.io.IOException: java.lang.RuntimeException: Error occurred while instantiating com.mapr.fs.hbase.HTableImpl11.
  49. ==> java.lang.NoSuchMethodError: com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.makeExtensionsImmutable()V.
  50.         at org.apache.hadoop.hbase.client.mapr.GenericHFactory.handleIOException(GenericHFactory.java:62)
  51.         at org.apache.hadoop.hbase.client.HTable.initIfMapRTableImpl(HTable.java:507)
  52.         at org.apache.hadoop.hbase.client.HTable.initIfMapRTable(HTable.java:462)
  53.         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:221)
  54.         at com.mapr.fs.hbase.MapRClusterConnectionImpl.getTable(MapRClusterConnectionImpl.java:174)
  55.         at com.mapr.fs.hbase.MapRClusterConnectionImpl.getTable(MapRClusterConnectionImpl.java:169)
  56.         at Main.pocMapr(Main.java:115)
  57.         at Main.main(Main.java:100)
  58. Caused by: java.lang.RuntimeException: Error occurred while instantiating com.mapr.fs.hbase.HTableImpl11.
  59. ==> java.lang.NoSuchMethodError: com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.makeExtensionsImmutable()V.
  60.         at org.apache.hadoop.hbase.client.mapr.GenericHFactory.getImplementorInstance(GenericHFactory.java:40)
  61.         at org.apache.hadoop.hbase.client.HTable.createMapRTable(HTable.java:537)
  62.         at org.apache.hadoop.hbase.client.HTable.initIfMapRTableImpl(HTable.java:504)
  63.         ... 6 more
  64. Caused by: java.lang.reflect.InvocationTargetException
  65.         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  66.         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  67.         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  68.         at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  69.         at org.apache.hadoop.hbase.client.mapr.GenericHFactory.getImplementorInstance(GenericHFactory.java:37)
  70.         ... 8 more
  71. Caused by: java.lang.NoSuchMethodError: com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.makeExtensionsImmutable()V
  72.         at com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.<init>(Dbserver.java)
  73.         at com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.<init>(Dbserver.java)
  74.         at com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse$1.parsePartialFrom(Dbserver.java)
  75.         at com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse$1.parsePartialFrom(Dbserver.java)
  76.         at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:139)
  77.         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:173)
  78.         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:185)
  79.         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:190)
  80.         at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
  81.         at com.mapr.fs.proto.Dbserver$ColumnFamilyScanResponse.parseFrom(Dbserver.java)
  82.         at com.mapr.fs.MapRHTable.refreshSchema(MapRHTable.java:649)
  83.         at com.mapr.fs.MapRHTable.init(MapRHTable.java:99)
  84.         at com.mapr.fs.hbase.HTableImpl.<init>(HTableImpl.java:94)
  85.         at com.mapr.fs.hbase.HTableImpl11.<init>(HTableImpl11.java:57)
  86.         ... 13 more

很明显，有一个函数丢失了。但我没找到合适的jar。
有人能帮忙吗？
谢谢

hadoopJarmapr

2条答案

按热度按时间
wi3ka0sx

wi3ka0sx1#

解决了的！
有问题的是hive-exec.jar，我已经删除了它。

赞(0）分享  回复(0）举报  2021-06-01
scyqe7ek

scyqe7ek2#

你能告诉我你想用maprdb表做什么吗？你想扫描现有的表吗？

赞(0）分享  回复(0）举报  2021-06-01
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com