kubernetes Fluentd HTTP status=400 URI=/_bulk，响应：

wko9yo5t 于 2023-04-29 发布在 Kubernetes

关注(0)|答案(1)|浏览(298)

我不想发送pod日志到ELK，但在部署fluentd后，我收到了错误，我从教程中获得了官方Fluentd文档
EKS版本1。22
我将Suppress_Type_Name设置为On，但未解决此问题

[2022/06/20 16:23:07] [error] [output:es:es.0] HTTP status=400 URI=/_bulk, response:
{"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Action/metadata line [1] contains an unknown parameter [_type]"}],"type":"illegal_argument_exception","reason":"Action/metadata line [1] contains an unknown parameter [_type]"},"status":400}

我的配置Map

fluent-bit.conf: |
    [SERVICE]
        Flush         1
        Log_Level     info
        Daemon        off
        Parsers_File  parsers.conf
        HTTP_Server   On
        HTTP_Listen   0.0.0.0
        HTTP_Port     2020

    @INCLUDE input-kubernetes.conf
    @INCLUDE filter-kubernetes.conf
    @INCLUDE output-elasticsearch.conf

  input-kubernetes.conf: |
    [INPUT]
        Name              tail
        Tag               kube.*
        Path              /var/log/containers/*.log
        Parser            docker
        DB                /var/log/flb_kube.db
        Mem_Buf_Limit     5MB
        Skip_Long_Lines   On
        Refresh_Interval  10

  filter-kubernetes.conf: |
    [FILTER]
        Name                kubernetes
        Match               kube.*
        Kube_URL            https://kubernetes.default.svc:443
        Kube_CA_File        /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
        Kube_Token_File     /var/run/secrets/kubernetes.io/serviceaccount/token
        Kube_Tag_Prefix     kube.var.log.containers.
        Merge_Log           On
        Merge_Log_Key       log_processed
        K8S-Logging.Parser  On
        K8S-Logging.Exclude Off

  output-elasticsearch.conf: |
    [OUTPUT]
        Name            es
        Match           *
        Host            ${FLUENT_ELASTICSEARCH_HOST}
        Port            ${FLUENT_ELASTICSEARCH_PORT}
        Logstash_Format On
        Replace_Dots    On
        Retry_Limit     False

kubernetes

来源：https://stackoverflow.com/questions/72690157/fluentd-http-status-400-uri-bulk-response

1条答案

按热度按时间

8ehkhllq1#

我通过这三个步骤解决了这个问题，
步骤1.您需要将Fluentbit映像更新为最新版本

image: fluent/fluent-bit:2.1.1

您可以从here获取部署文件
步骤2：将“Suppress_Type_Name On”添加到output-elasticsearch。会议

output-elasticsearch.conf: |
    [OUTPUT]
        Name            es
        Match           *
        Host            ${FLUENT_ELASTICSEARCH_HOST}
        Port            ${FLUENT_ELASTICSEARCH_PORT}
        HTTP_User       ${FLUENT_ELASTICSEARCH_USER}
        HTTP_Passwd     ${FLUENT_ELASTICSEARCH_PASSWORD}
        Logstash_Format On
        Replace_Dots    On
        Retry_Limit     False
        Suppress_Type_Name On

步骤3.删除fluentbit pod并重新应用它

kubectl delete -f fluentbit-ds.yaml
kubectl apply -f fluentbit-ds.yaml

赞(0）回复(0）举报 2023-04-29

我来回答

kubernetes Fluentd HTTP status=400 URI=/_bulk，响应：

1条答案

相关问题

热门标签

最新问答