zoukankan      html  css  js  c++  java
  • linux的统计实现

    场景:

    将下面的数据里category里的分类统计计数

    数据源

    es_ip10000.json

    {"_index":"order","_type":"service","_id":"107.151.83.180:22","_score":1,"_source":{"ip":"107.151.83.180","parent_category":["支撑系统"],"category":["其他支撑系统"]}}
    {"_index":"order","_type":"service","_id":"107.151.84.167:22","_score":1,"_source":{"ip":"107.151.84.167","parent_category":["支撑系统"],"category":["其他支撑系统"]}}
    {"_index":"order","_type":"service","_id":"107.151.84.177:22","_score":1,"_source":{"ip":"107.151.84.177","parent_category":["支撑系统"],"category":["其他支撑系统"]}}
    {"_index":"order","_type":"service","_id":"107.152.188.252:1723","_score":1,"_source":{"ip":"107.152.188.252","parent_category":["网络产品"],"category":["路由器"]}}
    {"_index":"order","_type":"service","_id":"107.151.89.125:1025","_score":1,"_source":{"ip":"107.151.89.125"}}
    {"_index":"order","_type":"service","_id":"107.152.58.217:22","_score":1,"_source":{"ip":"107.152.58.217","parent_category":["支撑系统"],"category":["服务"]}}
    {"_index":"order","_type":"subdomain","_id":"107.15.221.83:443","_score":1,"_source":{"ip":"107.15.221.83","parent_category":["办公外设","系统软件"],"category":["打印机","操作系统"]}}
    

    _source下的category字段

    cat es_ip10000.json | jq ._source.category > category.txt

    输出结果

    [
      "其他支撑系统"
    ]
    [
      "其他支撑系统"
    ]
    [
      "其他支撑系统"
    ]
    [
      "路由器"
    ]
    null
    [
      "服务"
    ]
    [
      "打印机",
      "操作系统"
    ]
    
    

    用编辑器,去除 , []

    处理后的结果

    
      "其他支撑系统"
    
    
      "其他支撑系统"
    
    
      "其他支撑系统"
    
    
      "路由器"
    
    null
    
      "服务"
    
    
      "打印机"
      "操作系统"
    
    

    排序 > 去重->统计->再排序

    cat category.txt | sort | uniq -c | sort -n >category_count.txt

    说明:

    uniq -c #去重并统计

    sort -n # 正序排序

    sort -r # 倒序排序

    输出结果:

          1 null
          1   "操作系统"
          1   "打印机"
          1   "服务"
          1   "路由器"
          3   "其他支撑系统"
         12 
    
    [Haima的博客] http://www.cnblogs.com/haima/
  • 相关阅读:
    MOSS的权限控制很好很强大的
    infopath:InfoPath 上传多附件解决思路方法
    http://www.cnblogs.com/ahjxxy/archive/2010/08/09/1796125.html
    MOSS-批量自定义列表项权限
    ABAP中ALV导出excel表格时有个字段总是少一位,请问是什么原因?如何解决?
    SAP ABAP AT NEW 和AT END OF的用法
    ABAP 的message 的创建及使用
    Screen返回选择界面的问题
    SPELL_AMOUNT
    【ABAP内表】关于At first/ At last/ At new /At end of
  • 原文地址:https://www.cnblogs.com/haima/p/15118877.html
Copyright © 2011-2022 走看看