清理titan base会导致超时异常(backend=hbase)

rsaldnfx  于 2021-06-09  发布在  Hbase
关注(0)|答案(2)|浏览(334)

我试图清理我的泰坦数据库,导致了一个异常。我猜我的数据库是大的,它击中超时,但是,我怎么能在泰坦配置这个然后。我使用hbase作为存储后端。这是我返回异常的代码;泰坦版本:0.4.4

g.shutdown();
TitanCleanup.clear(g);

Exception in thread "main" com.thinkaurelius.titan.core.TitanException: Unexpected exception during backend operation
    at com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:67)
    at com.thinkaurelius.titan.core.util.TitanCleanup.clear(TitanCleanup.java:32)
    at TitanMain.main(TitanMain.java:39)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hbase.client.ScannerTimeoutException: 106728ms passed since the last invocation, timeout is currently set to 60000
    at org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:44)
    at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.clearStorage(HBaseStoreManager.java:358)
    at com.thinkaurelius.titan.diskstorage.Backend.clearStorage(Backend.java:465)
    at com.thinkaurelius.titan.core.util.TitanCleanup$1.call(TitanCleanup.java:35)
    at com.thinkaurelius.titan.core.util.TitanCleanup$1.call(TitanCleanup.java:32)
    at com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:62)
    ... 7 more
Caused by: org.apache.hadoop.hbase.client.ScannerTimeoutException: 106728ms passed since the last invocation, timeout is currently set to 60000
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:283)
    at org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:41)
    ... 12 more
Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: -3465920678372616028
    at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2625)
    at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:323)
    at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1434)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
    at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:149)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:42)
    at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:163)
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:274)
    ... 13 more
bd1hkmkf

bd1hkmkf1#

嗯,我已经重新启动了,现在它可以做清晰的操作了。很奇怪,但它现在起作用了。

zbdgwd5y

zbdgwd5y2#

Caused by: org.apache.hadoop.hbase.client.ScannerTimeoutException: 106728ms passed since the last invocation, timeout is currently set to 60000 @HBasStoreManager。java:358 means 从hbase中删除一行花了约107秒。对于一个人来说,这是一段荒谬的漫长时间 HTable.delete 打电话。你的集群或客户端有什么问题吗?您可以在这里看到有问题的代码:https://github.com/thinkaurelius/titan/blob/0.4.4/titan-hbase/src/main/java/com/thinkaurelius/titan/diskstorage/hbase/hbasestoremanager.java#l358

相关问题