storm：无法使用keypostopology-1-1501640527-stormconf.ser更新blob

wtzytmuj  于 2021-06-24  发布在  Storm
关注(0)|答案(0)|浏览(294)

我正在构建一个包含jdbc和redis的storm拓扑，运行几个小时后，显示：

  1. [2017-08-02 17:37:59.917] ERROR [org.apache.storm.blobstore.BlobStoreUtils:197] - Could not update the blob with keypositionTopology-1-1501640527-stormconf.ser 
  2. [2017-08-02 17:37:59.930] ERROR [org.apache.storm.blobstore.BlobStoreUtils:197] - Could not update the blob with keypositionTopology-1-1501640527-stormcode.ser

然后它告诉我：

  1. [2017-08-02 20:39:01.610] INFO  [org.apache.storm.shade.org.apache.zookeeper.ClientCnxn:1096] - Client session timed out, have not heard from server in 13374ms for sessionid 0x15da0c008310049, closing socket connection and attempting reconnect
  2. [2017-08-02 20:39:01.611] WARN  [org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn:357] - caught end of stream exception:
  3. org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15da0c008310049, likely client has closed socket
  4. at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [storm-core-1.0.2.jar:1.0.2]
  5. at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [storm-core-1.0.2.jar:1.0.2]
  6. at java.lang.Thread.run(Thread.java:748) [?:1.8.0_141] 
  7. [2017-08-02 20:39:01.614] INFO  [org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn:1007] - Closed socket connection for client /0:0:0:0:0:0:0:1:62631 which had sessionid 0x15da0c008310048
  8. [2017-08-02 20:39:01.711] INFO  [org.apache.storm.shade.org.apache.curator.framework.state.ConnectionStateManager:228] - State change: SUSPENDED
  9. [2017-08-02 20:39:01.711] WARN  [org.apache.storm.cluster-state.zookeeper-state-factory:  0] - Received event :disconnected::none: with disconnected Writer Zookeeper.
  10. [2017-08-02 20:39:01.713] INFO  [org.apache.storm.shade.org.apache.curator.framework.state.ConnectionStateManager:228] - State change: SUSPENDED
  11. [2017-08-02 20:39:01.713] WARN  [org.apache.storm.cluster-state.zookeeper-state-factory:  0] - Received event :disconnected::none: with disconnected Writer Zookeeper.
  12. [2017-08-02 20:39:01.713] INFO  [org.apache.storm.zookeeper:  0] - Zookeeper state update: :disconnected:none
  13. [2017-08-02 20:39:01.713] INFO  [org.apache.storm.zookeeper:  0] - debian lost leadership.

而这次转变。。。

  1. [2017-08-02 20:59:30.930] WARN  [org.apache.storm.kafka.PartitionManager:218] - Removing the failed offsets for Partition{host=10.2.5.207:9092, topic=grih_pos, partition=0} that are out of range: [1786800768, 1786800769, 1786800770, 1786800771, 1786800772, 1786800773, 1786800774, 1786800775, 1786800776, 1786800777, 1786800778, 1786800779, 1786800780, 1786800781, 1786800782, 1786800783, 1786800784, 1786800785, 1786800786, 1786800787, 1786800788, 1786800789, 1786800790, 1786800791, 1786800792, 1786800793, 1786800794, 1786800795, 1786800796, 1786800797, 1786800798, 1786800799, 1786800800, 1786800801, 1786800802, 1786800803, 1786800804, 1786800805, 1786800806, 1786800807, 1786800808, 1786800809, 1786800810, 1786800811, 1786800812, 1786800813, 1786800814, 1786800815, 1786800816, 1786800817, 1786800818, 1786800819, 1786800820, 1786800821, 1786800822, 1786800823, 1786800824, 1786800825, 1786800826, 1786800827, 1786800828, 1786800829, 1786800830, 1786800831, 1786800832, 1786800833, 1786800834, 1786800835, 1786800836, 1786800837, blablabla...

最后，oom：

  1. [2017-08-02 22:30:16.311] INFO  [org.apache.storm.shade.org.apache.zookeeper.ClientCnxn:512] - EventThread shut down
  2. [2017-08-02 22:30:16.311] INFO  [org.apache.storm.shade.org.apache.zookeeper.ZooKeeper:438] - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@58f254b1
  3. [2017-08-02 22:30:16.309] INFO  [org.apache.storm.shade.org.apache.zookeeper.ZooKeeper:438] - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@437ed416
  4. [2017-08-02 22:30:21.338] WARN  [org.apache.storm.shade.org.apache.curator.ConnectionState:191] - Connection attempt unsuccessful after 25460 (greater than max timeout of 20000). Resetting connection and trying again with a new connection.
  5. [2017-08-02 22:30:21.341] INFO  [org.apache.storm.shade.org.apache.zookeeper.ClientCnxn:975] - Opening socket connection to server 127.0.0.1/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
  6. [2017-08-02 22:30:21.338] ERROR [org.apache.storm.shade.org.apache.curator.ConnectionState:200] - Connection timed out for connection string (localhost:2000) and timeout (15000) / elapsed (15162)
  7. org.apache.storm.shade.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
  8. at org.apache.storm.shade.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:197) [storm-core-1.0.2.jar:1.0.2]
  9. at org.apache.storm.shade.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [storm-core-1.0.2.jar:1.0.2]
  10. at org.apache.storm.shade.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:116) [storm-core-1.0.2.jar:1.0.2]
  11. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) [storm-core-1.0.2.jar:1.0.2]
  12. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) [storm-core-1.0.2.jar:1.0.2]
  13. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) [storm-core-1.0.2.jar:1.0.2]
  14. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) [storm-core-1.0.2.jar:1.0.2]
  15. at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_141]
  16. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_141]
  17. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_141]
  18. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_141]
  19. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_141]
  20. at java.lang.Thread.run(Thread.java:748) [?:1.8.0_141]
  21. [2017-08-02 22:30:21.342] INFO  [org.apache.storm.shade.org.apache.zookeeper.ClientCnxn:852] - Socket connection established to 127.0.0.1/127.0.0.1:2000, initiating session
  22. [2017-08-02 22:30:28.864] WARN  [org.apache.storm.shade.org.apache.curator.ConnectionState:191] - Connection attempt unsuccessful after 32985 (greater than max timeout of 20000). Resetting connection and trying again with a new connection.
  23. [2017-08-02 22:30:41.625] INFO  [org.apache.storm.shade.org.apache.zookeeper.ClientCnxn:975] - Opening socket connection to server 127.0.0.1/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
  24. [2017-08-02 22:30:41.631] ERROR [org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl:566] - Background exception was not retry-able or retry gave up
  25. java.lang.OutOfMemoryError: GC overhead limit exceeded
  26. at java.lang.String.substring(String.java:1969) ~[?:1.8.0_141]
  27. at java.lang.Package.getPackage(Package.java:331) ~[?:1.8.0_141]
  28. at java.lang.Class.getPackage(Class.java:796) ~[?:1.8.0_141]
  29. at org.apache.logging.log4j.core.impl.ThrowableProxy.toCacheEntry(ThrowableProxy.java:495) ~[log4j-core-2.1.jar:2.1]
  30. at org.apache.logging.log4j.core.impl.ThrowableProxy.toExtendedStackTrace(ThrowableProxy.java:547) ~[log4j-core-2.1.jar:2.1]
  31. at org.apache.logging.log4j.core.impl.ThrowableProxy.<init>(ThrowableProxy.java:113) ~[log4j-core-2.1.jar:2.1]
  32. at org.apache.logging.log4j.core.impl.Log4jLogEvent.getThrownProxy(Log4jLogEvent.java:323) ~[log4j-core-2.1.jar:2.1]
  33. at org.apache.logging.log4j.core.pattern.ExtendedThrowablePatternConverter.format(ExtendedThrowablePatternConverter.java:64) ~[log4j-core-2.1.jar:2.1]
  34. at org.apache.logging.log4j.core.pattern.PatternFormatter.format(PatternFormatter.java:36) ~[log4j-core-2.1.jar:2.1]
  35. at org.apache.logging.log4j.core.layout.PatternLayout.toSerializable(PatternLayout.java:197) ~[log4j-core-2.1.jar:2.1]
  36. at org.apache.logging.log4j.core.layout.PatternLayout.toSerializable(PatternLayout.java:55) ~[log4j-core-2.1.jar:2.1]
  37. at org.apache.logging.log4j.core.layout.AbstractStringLayout.toByteArray(AbstractStringLayout.java:67) ~[log4j-core-2.1.jar:2.1]
  38. at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:108) ~[log4j-core-2.1.jar:2.1]
  39. at org.apache.logging.log4j.core.appender.RollingFileAppender.append(RollingFileAppender.java:88) ~[log4j-core-2.1.jar:2.1]
  40. at org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:99) ~[log4j-core-2.1.jar:2.1]
  41. at org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:430) ~[log4j-core-2.1.jar:2.1]
  42. at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:409) ~[log4j-core-2.1.jar:2.1]
  43. at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:367) ~[log4j-core-2.1.jar:2.1]
  44. at org.apache.logging.log4j.core.Logger.logMessage(Logger.java:112) ~[log4j-core-2.1.jar:2.1]
  45. at org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:727) ~[log4j-api-2.1.jar:2.1]
  46. at org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:716) ~[log4j-api-2.1.jar:2.1]
  47. at org.apache.logging.slf4j.Log4jLogger.error(Log4jLogger.java:318) ~[log4j-slf4j-impl-2.1.jar:2.1]
  48. at org.apache.storm.shade.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:200) ~[storm-core-1.0.2.jar:1.0.2]
  49. at org.apache.storm.shade.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) ~[storm-core-1.0.2.jar:1.0.2]
  50. at org.apache.storm.shade.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:116) ~[storm-core-1.0.2.jar:1.0.2]
  51. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) ~[storm-core-1.0.2.jar:1.0.2]
  52. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) ~[storm-core-1.0.2.jar:1.0.2]
  53. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) ~[storm-core-1.0.2.jar:1.0.2]
  54. at org.apache.storm.shade.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) ~[storm-core-1.0.2.jar:1.0.2]
  55. at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_141]
  56. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_141]
  57. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_141]

我只是在这个拓扑中设置了两个螺栓，一个用于jdbc，另一个用于redis，其出口是kafkaspout，使用来自kafka的数据。
这个问题困扰了我很长时间，我谷歌了一遍又一遍，没有得到任何改变。。
渴望你的帮助！

Javaredisjdbcapache-storm

暂无答案！

目前还没有任何答案，快来回答吧！

我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com