我正在群集模式下运行kafka mirrormaker2群集。现在,我有我的mm2映像的5个副本,我正在将2个主题从3个源集群镜像到1个目标集群。在重新启动集群之后,我在这个大主题上有一些延迟,并且由于它们,我得到了大量的日志,比如我在下面添加的代码片段。
STDOUT: [2020-07-29 09:45:09,637] INFO [Worker clientId=connect-8, groupId=local-sa-mm2] Rebalance started (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:222)
STDOUT: [2020-07-29 09:45:09,637] INFO [Worker clientId=connect-8, groupId=local-sa-mm2] (Re-)joining group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552)
STDOUT: [2020-07-29 09:45:09,637] INFO [Worker clientId=connect-2, groupId=local-chi-mm2] Successfully joined group with generation 9088 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:503)
STDOUT: [2020-07-29 09:45:09,637] INFO [Worker clientId=connect-2, groupId=local-chi-mm2] Joined group at generation 9088 with protocol version 2 and got assignment: Assignment{error=0, leader='connect-1-cb7aa52c-a29a-4cf9-8f50-b691ba38aa3d', leaderUrl='NOTUSED/local-chi', offset=1178, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} with rebalance delay: 0 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1549)
STDOUT: [2020-07-29 09:45:09,637] WARN [Worker clientId=connect-2, groupId=local-chi-mm2] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1020)
STDOUT: [2020-07-29 09:45:09,637] INFO [Worker clientId=connect-2, groupId=local-chi-mm2] Current config state offset -1 is behind group assignment 1178, reading to end of config log (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1081)
STDOUT: [2020-07-29 09:45:09,686] INFO [Worker clientId=connect-8, groupId=local-sa-mm2] Successfully joined group with generation 9163 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:503)
STDOUT: [2020-07-29 09:45:09,686] INFO [Worker clientId=connect-8, groupId=local-sa-mm2] Joined group at generation 9163 with protocol version 2 and got assignment: Assignment{error=0, leader='connect-8-57ac5d76-cd00-49c3-bd42-8550a3f20b73', leaderUrl='NOTUSED/local-sa', offset=1387, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} with rebalance delay: 0 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1549)
STDOUT: [2020-07-29 09:45:09,686] WARN [Worker clientId=connect-8, groupId=local-sa-mm2] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1020)
有人知道在这种情况下该怎么办吗?我还没有找到与mirrormaker2特别相关的信息。我试图从目标集群中删除每个源集群的配置主题,然后再次重新启动mm2集群,但这似乎没有起到任何作用。
如有任何帮助或建议,将不胜感激。:)
暂无答案!
目前还没有任何答案,快来回答吧!