zoukankan      html  css  js  c++  java
  • 【原创】大叔经验分享(75)常用组件日志清理

    包括cloudera-manager、hdfs、impala、kudu、oozie以及系统日志等;

    #cloudera-service-monitor log
    /bin/rm /var/lib/cloudera-service-monitor/ts/*/partition*/* -rf
    /bin/rm /var/lib/cloudera-host-monitor/ts/*/partition*/* -rf
    
    #hdfs log
    /bin/rm /var/log/hadoop-hdfs/*.out.*
    /bin/rm /var/log/hadoop-hdfs/hdfs-audit.log.*
    
    #impala log
    num=`ls /var/log/impalad/|grep 'impala.log.INFO'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.INFO'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    num=`ls /var/log/impalad/|grep 'impala.log.WARNING'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.WARNING'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    num=`ls /var/log/impalad/|grep 'impala.log.ERROR'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.ERROR'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    
    num=`ls /var/log/impalad/profiles/|wc -l`
    ls /var/log/impalad/profiles/|sed $num'd'|xargs -i /bin/rm /var/log/impalad/profiles/{}
    
    #kudu log
    num=`ls /var/log/kudu/|grep 'log.INFO'|wc -l`
    ls /var/log/kudu/|grep 'log.INFO'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.ERROR'|wc -l`
    ls /var/log/kudu/|grep 'log.ERROR'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.FATAL'|wc -l`
    ls /var/log/kudu/|grep 'log.FATAL'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.WARNING'|wc -l`
    ls /var/log/kudu/|grep 'log.WARNING'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    /bin/rm /var/log/kudu/*.gz #oozie log num=`ls /var/log/oozie/|grep 'log.out-'|wc -l` ls /var/log/oozie/|grep 'log.out-'|sed $num'd'|xargs -i /bin/rm /var/log/oozie/{} /bin/rm /var/log/oozie/oozie-instrumentation.log.* #system journal /bin/rm /var/log/journal/*/system@00000000000000000000000000000000-*.journal /bin/rm -rf /var/log/messages-*
  • 相关阅读:
    Django集成Bootstrap美化后台
    python3 Django集成Ueditor富文本编辑器
    mysql-cluster集群配置
    centos7安装mysql8
    python升级pip和Django安装
    删除某日期之前的日志文件夹
    linux文件系统变为只读解决
    xargs实例
    linux终端提示符显示bash-4.2#
    Codeforces Round #478 (Div. 2)
  • 原文地址:https://www.cnblogs.com/barneywill/p/11127383.html
Copyright © 2011-2022 走看看