我有一个麋鹿设置,其中一个logstash是推数据到Kafka和另一个logstash是从Kafka拉数据。
下面是我的kafka输入配置,用于从中提取数据的logstashkafka:-
input {
kafka {
zk_connect => "kafka:2181"
group_id => "logstash"
topic_id => "logstash_logs"
reset_beginning => false
consumer_threads => 3
}
}
我已经讨论了这个github问题&&我的logstash主题有3个分区。
启动logstash后,我看到以下警告,logstash没有从中提取任何数据kafka:-
'[DEPRECATED] use `require 'concurrent'` instead of `require 'concurrent_ruby'`
log4j, [2015-10-27T00:11:50.471] WARN: kafka.consumer.RangeAssignor: No broker partitions consumed by consumer thread logstash_logstash-indexer-1445884909915-d6a99924-2 for topic logstash_logs
log4j, [2015-10-27T00:11:50.471] WARN: kafka.consumer.RangeAssignor: No broker partitions consumed by consumer thread logstash_logstash-indexer-1445884909915-d6a99924-0 for topic logstash_logs
log4j, [2015-10-27T00:11:50.471] WARN: kafka.consumer.RangeAssignor: No broker partitions consumed by consumer thread logstash_logstash-indexer-1445884909915-d6a99924-1 for topic logstash_logs
Logstash startup completed
环境-
日志存储-1.5.3
Kafka-0.8.2.1
有人能告诉我还能出什么问题吗?
1条答案
按热度按时间vdzxcuhz1#
这已经在elasticsearch讨论组中得到了回答。