canal-1.1.5版本zookeeper中cursor长时间没有更新

ryhaxcpt  于 1个月前  发布在  Zookeeper
关注(0)|答案(2)|浏览(40)
  • I have searched the issues of this repository and believe that this is not a duplicate.
  • I have checked the FAQ of this repository and believe that this is not a duplicate.

environment

  • canal-1.1.5
  • mysql8.0.18

Issue Description

我看原先的issue中提到 gtid模式下,会存在长期不更新zookeeper中cursor的问题,但是这个bug在canal1.1.5中被修复
我的情况是我没有使用gtid模式
instance下的配置是
canal.instance.gtidon=false

我采用的是canal-admin管理的canal-server集群运行 instance任务,但是出现了zookeeper中cursor长时间没有更新的情况,
2022-12-01 canal-server日志出现下面的连接canal-admin的问题,但是在2023-01-12发现instance任务被停止了,重新启动任务无法启动找不到binlog位点,然后定位到zookeeper中保存的消费位点还是12-01时提交的,中间canal-server依旧正常在运行

Steps to reproduce

Expected behaviour

Actual behaviour

If there is an exception, please attach the exception trace:
root@canal-server-2:/canal-server/canal-server/logs/agg__link_point__open_api_job/2022-12-01# zcat agg__link_point__open_api_job-2022-12-01-0.log.gz
2022-12-01 11:36:23.754 [pool-44-thread-1] ERROR c.a.o.canal.instance.spring.SpringCanalInstanceGenerator - generator instance failed.
com.alibaba.otter.canal.common.CanalException: load manager config failed.
Caused by: java.lang.RuntimeException: requestGet remote error, request : http://canal-admin-0.canal-admin.fcwl1-iot-dc.svc.cluster.local:8089/api/v1/config/instance_polling/agg__link_point__open_api_job?md5=
at com.alibaba.otter.canal.instance.manager.plain.HttpHelper.get(HttpHelper.java:100) ~[canal.instance.manager-1.1.5.jar:na]
at com.alibaba.otter.canal.instance.manager.plain.PlainCanalConfigClient.doQuery(PlainCanalConfigClient.java:121) ~[canal.instance.manager-1.1.5.jar:na]
at com.alibaba.otter.canal.instance.manager.plain.PlainCanalConfigClient.queryConfig(PlainCanalConfigClient.java:110) ~[canal.instance.manager-1.1.5.jar:na]
at com.alibaba.otter.canal.instance.manager.plain.PlainCanalConfigClient.findInstance(PlainCanalConfigClient.java:88) ~[canal.instance.manager-1.1.5.jar:na]
at com.alibaba.otter.canal.instance.manager.PlainCanalInstanceGenerator.generate(PlainCanalInstanceGenerator.java:41) ~[canal.instance.manager-1.1.5.jar:na]
at com.alibaba.otter.canal.deployer.CanalController.lambda$initGlobalConfig$2(CanalController.java:374) [canal.deployer-1.1.5.jar:na]
at com.alibaba.otter.canal.server.embedded.CanalServerWithEmbedded.lambda$start$0(CanalServerWithEmbedded.java:78) ~[canal.server-1.1.5.jar:na]
at com.google.common.collect.MigrateMap$1.load(MigrateMap.java:23) ~[canal.common-1.1.5.jar:na]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3708) ~[guava-22.0.jar:na]
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2416) ~[guava-22.0.jar:na]
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2299) ~[guava-22.0.jar:na]
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2212) ~[guava-22.0.jar:na]
at com.google.common.cache.LocalCache.get(LocalCache.java:4147) ~[guava-22.0.jar:na]
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4151) ~[guava-22.0.jar:na]
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:5140) ~[guava-22.0.jar:na]
at com.google.common.collect.MigrateMap$MigrateConcurrentMap.get(MigrateMap.java:68) ~[canal.common-1.1.5.jar:na]
at com.alibaba.otter.canal.server.embedded.CanalServerWithEmbedded.start(CanalServerWithEmbedded.java:128) ~[canal.server-1.1.5.jar:na]
at com.alibaba.otter.canal.deployer.CanalController$1.processActiveEnter(CanalController.java:152) ~[canal.deployer-1.1.5.jar:na]
at com.alibaba.otter.canal.common.zookeeper.running.ServerRunningMonitor.processActiveEnter(ServerRunningMonitor.java:242) ~[canal.common-1.1.5.jar:na]
at com.alibaba.otter.canal.common.zookeeper.running.ServerRunningMonitor.initRunning(ServerRunningMonitor.java:145) ~[canal.common-1.1.5.jar:na]
at com.alibaba.otter.canal.common.zookeeper.running.ServerRunningMonitor.access$600(ServerRunningMonitor.java:29) ~[canal.common-1.1.5.jar:na]
at com.alibaba.otter.canal.common.zookeeper.running.ServerRunningMonitor$1.lambda$handleDataDeleted$0(ServerRunningMonitor.java:76) ~[canal.common-1.1.5.jar:na]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_212]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_212]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_212]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_212]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_212]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_212]
at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_212]
Caused by: java.net.UnknownHostException: canal-admin-0.canal-admin.fcwl1-iot-dc.svc.cluster.local
at java.net.InetAddress.getAllByName0(InetAddress.java:1281) ~[na:1.8.0_212]
at java.net.InetAddress.getAllByName(InetAddress.java:1193) ~[na:1.8.0_212]
at java.net.InetAddress.getAllByName(InetAddress.java:1127) ~[na:1.8.0_212]
at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:111) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184) ~[httpclient-4.5.1.jar:4.5.1]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) ~[httpclient-4.5.1.jar:4.5.1]
at com.alibaba.otter.canal.instance.manager.plain.HttpHelper.get(HttpHelper.java:90) ~[canal.instance.manager-1.1.5.jar:na]
... 28 common frames omitted

Just put your stack trace here!
46scxncf

46scxncf2#

请问解决了吗

没有,找不到是啥问题

相关问题