zoukankan      html  css  js  c++  java
  • 【原创】大叔经验分享(75)常用组件日志清理

    包括cloudera-manager、hdfs、impala、kudu、oozie以及系统日志等;

    #cloudera-service-monitor log
    /bin/rm /var/lib/cloudera-service-monitor/ts/*/partition*/* -rf
    /bin/rm /var/lib/cloudera-host-monitor/ts/*/partition*/* -rf
    
    #hdfs log
    /bin/rm /var/log/hadoop-hdfs/*.out.*
    /bin/rm /var/log/hadoop-hdfs/hdfs-audit.log.*
    
    #impala log
    num=`ls /var/log/impalad/|grep 'impala.log.INFO'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.INFO'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    num=`ls /var/log/impalad/|grep 'impala.log.WARNING'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.WARNING'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    num=`ls /var/log/impalad/|grep 'impala.log.ERROR'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.ERROR'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    
    num=`ls /var/log/impalad/profiles/|wc -l`
    ls /var/log/impalad/profiles/|sed $num'd'|xargs -i /bin/rm /var/log/impalad/profiles/{}
    
    #kudu log
    num=`ls /var/log/kudu/|grep 'log.INFO'|wc -l`
    ls /var/log/kudu/|grep 'log.INFO'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.ERROR'|wc -l`
    ls /var/log/kudu/|grep 'log.ERROR'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.FATAL'|wc -l`
    ls /var/log/kudu/|grep 'log.FATAL'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.WARNING'|wc -l`
    ls /var/log/kudu/|grep 'log.WARNING'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    /bin/rm /var/log/kudu/*.gz #oozie log num=`ls /var/log/oozie/|grep 'log.out-'|wc -l` ls /var/log/oozie/|grep 'log.out-'|sed $num'd'|xargs -i /bin/rm /var/log/oozie/{} /bin/rm /var/log/oozie/oozie-instrumentation.log.* #system journal /bin/rm /var/log/journal/*/system@00000000000000000000000000000000-*.journal /bin/rm -rf /var/log/messages-*
  • 相关阅读:
    站点防攻击之禁止国外ip
    docker 安装rabbitMQ
    【转】浅析支付系统的整体架构
    【转】MQ详解及四大MQ比较
    SQL server 中的dbo、guest
    网站加载速度的优化(1):优化前端页面
    【转】Apache ab压力测试
    Asp.Net Core 部署发布后EFCore数据库断连和Google浏览器无法存储Cookie
    C# 使用nuget.exe发布类库及更新类库
    .net core 读取Excal文件数据及注意事项
  • 原文地址:https://www.cnblogs.com/barneywill/p/11127383.html
Copyright © 2011-2022 走看看