zoukankan      html  css  js  c++  java
  • filebeat更改mapping 字段类型

     采集nginx日志的时候发现从filebeat采集的json日志到elasticsearch里面都是keyword类型,导致我模糊查询部分字段的时候无法模糊匹配,所以需要将某些字段改成text类型。

    filebeat.inputs:
    - type: log
      enabled: true
      json.keys_under_root: true
      json.overwrite_keys: true
      paths:
        - "/x/*.log"
      tags: ["php-nginx-access"]
    
    output.elasticsearch:
      hosts: ["10.8.44.5:9200"]
      username: "xxx"
      password: "xxx"
      indices:
        - index: "php-nginx-access-%{[agent.version]}-%{+yyyy.MM}"
          when.contains:
            tags: "php-nginx-access"
    setup.template.name: "php-nginx-access"
    setup.template.pattern: "php-nginx-access-*"
    setup.template.fields: "myfields.yml"
    setup.template.overwrite: true
    setup.template.enabled: true
    setup.ilm.enabled: false

    关键的地方就是修改了fields.yml。

    - key: php-nginx-access
      title: php
      description: >
        php access log
      fields:
      - name: request
        type: text
        ignore_above: 1024
      - name: '@timestamp'
        level: core
        required: true
        type: date
        description: 'Date/time when the event originated.
    
          This is the date/time extracted from the event, typically representing when
          the event was generated by the source.
    
          If the event source has no original timestamp, this value is typically populated
          by the first time the event was received by the pipeline.
    
          Required field for all events.'
        example: '2016-05-23T08:05:34.853Z'
  • 相关阅读:
    小公司的10k前端工程师应该会什么?
    webService和Restful
    码农如何主动学习?
    20个Web前端开发工程师必看的国外网站
    网站主题和内容的三个类型
    HTTP慢速攻击
    Linux等待队列原理与实现
    签名你的每个 Git Commit
    浅谈 Linux 下常用 Socket 选项设置
    API接口设计,需要注意这4点
  • 原文地址:https://www.cnblogs.com/bill2014/p/14589426.html
Copyright © 2011-2022 走看看