filebeat-kafka:WARN producer/broker/0 maximum request accumulated, waiting for space

时间:2020-01-06 20:27:07   收藏:0   阅读:1024

You need to configure 3 things:

Here a example (change paths according your environment).

Broker configuration:

open kafka server configuration file

vim /opt/kafka/config/server.properties

add this line

The largest record batch size allowed by Kafka.

message.max.bytes=100000000

restart kafka service

systemctl restart kafka.service
Filebeat kafka output:

Consumer configuration:

larger than the max.message.size

max.partition.fetch.bytes=200000000

以下内容可以不添加

output.kafka:
...
max_message_bytes: 100000000

原文:https://www.cnblogs.com/doraman/p/kafka.html

评论(0
© 2014 bubuko.com 版权所有 - 联系我们:wmxa8@hotmail.com
打开技术之扣,分享程序人生!