[大数据]filebeat的使用(一) 从kafka log中读取数据

# Module: kafka
# Docs: https://www.elastic.co/guide/en/beats/filebeat/7.x/filebeat-module-kafka.html

- module: kafka
  # All logs
  log:
    enabled: true

    # Set custom paths for Kafka. If left empty,
    # Filebeat will look under /opt.
    #var.kafka_home:

    # Set custom paths for the log files. If left empty,
    # Filebeat will choose the paths depending on your OS.
    var.paths:
      - "/Users/xx/Downloads/1.log"
      - "/Users/xx/Downloads/2.log"

filebeat-7.14.0-darwin-x86_64/modules.d 设置kafka.yml文件，直接制定日志文件读取到es中，具体参考官方的说明案例。