运行kafka streams应用程序时出现以下错误。
ks应用程序加载大量(20gb)数据并将其保存在状态存储中。应用程序的初始阶段是将所有数据加载到statestore并获得以下错误。
我试图了解这个错误将如何影响我,以及我应该使用哪些可调参数来避免这些错误。
2020-09-27 13:41:02,063 1058071 [kafka-producer-network-thread | dp-App-ac0ad3b3-c9c5-4d0a-9d15-0122120f9d8b-StreamThread-2-producer] ERROR o.a.k.s.p.i.RecordCollectorImpl - stream-thread [dp-App-ac0ad3b3-c9c5-4d0a-9d15-0122120f9d8b-StreamThread-2] task [29_1] Error sending record to topic dp-App-Store-changelog due to Expiring 7 record(s) for dp-App-Store-changelog-1:300000 ms has passed since batch creation; No more records will be sent and no more offsets will be recorded for this task. Enable TRACE logging to view failed record key and value.
You can increase the producer configs `delivery.timeout.ms` and/or `retries` to avoid this error. Note that `retries` is set to infinite by default.
org.apache.kafka.common.errors.TimeoutException: Expiring 7 record(s) for dp-App-Store-changelog-1:300000 ms has passed since batch creation
有什么建议吗
暂无答案!
目前还没有任何答案,快来回答吧!