zoukankan      html  css  js  c++  java
  • logstash 如何处理 mongodb 导出来的 _id value数据。 how to custom fields of logstash by mongo mapreduce exported data.(example format: {_id:"xxx"} , value:{})

    input {  
          file {
              path => "c:aa.json"
              start_position => "beginning"
              #sincedb_path => "NUL"
              codec => json {
                charset => "UTF-8"
            }       
          }
    }
    filter {  
       json{
       source => "message"
       }
        #custom fields
        ruby {
           code => "event.set('users',event.get('value')['usertag'])
                    event.set('logcreatetime',event.get('value')['createtime'])
                    event.set('usertype',event.get('value')['usertype'])
                    event.set('userid',event.get('value')['userid'])
           "
        }
    
        mutate
        {
            remove_field => [ "message","path","@version","@timestamp","host","_id","value"] #删除字段 delete fields
        }
    }
    output {  
        elasticsearch {
            action => "index"
            hosts => ["http://localhost:9200"]
            index => "urnesteddb"
            document_type => "usertable"
            workers => 1
        }
         #stdout {
             #codec => rubydebug
             #codec => json_lines
         #}
    }
    
  • 相关阅读:
    IDE-常用插件
    Go-竞态条件-锁
    Go-发送邮件
    复刻网络Yum源配置为本地Yum源使用
    测试
    九.查找算法
    九.多线程-PDF笔记
    八.设计模式
    八.排序算法:复杂度
    七.注解
  • 原文地址:https://www.cnblogs.com/haoliansheng/p/6404652.html
Copyright © 2011-2022 走看看