我正在尝试在kafka 1.0.1上运行kafka mirror maker,下面是目标集群中的配置。
source.config文件
bootstrap.servers=XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092
groupid=test-MirrorMaker-group
exclude.internal.topics=true
mirror.topics.whitelist=test
client.id=mirror_maker_consumer
目标.config
bootstrap.servers=XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092
acks=1
batch.size=100
client.id=mirror_maker_producer
当我运行以下命令在目标集群上启动mirror maker时。
./kafka-run-class.sh kafka.tools.mirrormaker--consumer.config../config/source.config--producer.config../config/target.config--num.streams 2--whitelist=“测试”
我得到以下错误
[2018-03-22 20:52:09,164] WARN The configuration 'groupid' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,164] WARN The configuration 'mirror.topics.whitelist' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,174] WARN The configuration 'groupid' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,174] WARN The configuration 'mirror.topics.whitelist' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,373] ERROR [Consumer clientId=null-0, groupId=] Attempt to join group failed due to fatal error: The configured groupId is invalid (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-03-22 20:52:09,375] FATAL [mirrormaker-thread-0] Mirror maker thread failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.errors.InvalidGroupIdException: The configured groupId is invalid
[2018-03-22 20:52:09,375] ERROR [Consumer clientId=null-1, groupId=] Attempt to join group failed due to fatal error: The configured groupId is invalid (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-03-22 20:52:09,377] FATAL [mirrormaker-thread-1] Mirror maker thread failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.errors.InvalidGroupIdException: The configured groupId is invalid
[2018-03-22 20:52:09,386] FATAL [mirrormaker-thread-1] Mirror maker thread exited abnormally, stopping the whole mirror maker. (kafka.tools.MirrorMaker$MirrorMakerThread)
我错过什么了吗?
1条答案
按热度按时间njthzxwz1#
你打错了。用group.id替换groupid。