zoukankan      html  css  js  c++  java
  • filebeat更改mapping 字段类型

     采集nginx日志的时候发现从filebeat采集的json日志到elasticsearch里面都是keyword类型,导致我模糊查询部分字段的时候无法模糊匹配,所以需要将某些字段改成text类型。

    filebeat.inputs:
    - type: log
      enabled: true
      json.keys_under_root: true
      json.overwrite_keys: true
      paths:
        - "/x/*.log"
      tags: ["php-nginx-access"]
    
    output.elasticsearch:
      hosts: ["10.8.44.5:9200"]
      username: "xxx"
      password: "xxx"
      indices:
        - index: "php-nginx-access-%{[agent.version]}-%{+yyyy.MM}"
          when.contains:
            tags: "php-nginx-access"
    setup.template.name: "php-nginx-access"
    setup.template.pattern: "php-nginx-access-*"
    setup.template.fields: "myfields.yml"
    setup.template.overwrite: true
    setup.template.enabled: true
    setup.ilm.enabled: false

    关键的地方就是修改了fields.yml。

    - key: php-nginx-access
      title: php
      description: >
        php access log
      fields:
      - name: request
        type: text
        ignore_above: 1024
      - name: '@timestamp'
        level: core
        required: true
        type: date
        description: 'Date/time when the event originated.
    
          This is the date/time extracted from the event, typically representing when
          the event was generated by the source.
    
          If the event source has no original timestamp, this value is typically populated
          by the first time the event was received by the pipeline.
    
          Required field for all events.'
        example: '2016-05-23T08:05:34.853Z'
  • 相关阅读:
    括号匹配性检测C语言实现
    预处理命令--宏定义
    *运算和&运算
    retain, copy, assign以及autorelease
    自定义 一个单例
    多米音乐笔试题
    UI-自定义视图、视图控制器
    Foundation框架—集合
    Foundation框架—字符串
    Foundation框架—结构体
  • 原文地址:https://www.cnblogs.com/bill2014/p/14589426.html
Copyright © 2011-2022 走看看