zoukankan      html  css  js  c++  java
  • There are 2 missing blocks. The following files may be corrupted

    There are 2 missing blocks. The following files may be corrupted:

    步骤1,检查文件缺失情况

    可以看到, 

    blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

    确实各自都丢失了1个Block, 文件已经损坏,不可恢复。

    [root@master66 datacollectors]# hdfs fsck /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    Connecting to namenode via http://master66:50070
    FSCK started by root (auth:SIMPLE) from /10.3.70.116 for path /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210 at Thu Sep 06 09:23:04 CST 2018
    .
    /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: CORRUPT blockpool BP-1198174473-10.17.139.66-1492053574238 block blk_1074785806
    
    /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: MISSING 1 blocks of total size 41235 B.Status: CORRUPT
     Total size:    41235 B
     Total dirs:    0
     Total files:    1
     Total symlinks:        0
     Total blocks (validated):    1 (avg. block size 41235 B)
      ********************************
      CORRUPT FILES:    1
      MISSING BLOCKS:    1
      MISSING SIZE:        41235 B
      CORRUPT BLOCKS:     1
      ********************************
     Minimally replicated blocks:    0 (0.0 %)
     Over-replicated blocks:    0 (0.0 %)
     Under-replicated blocks:    0 (0.0 %)
     Mis-replicated blocks:        0 (0.0 %)
     Default replication factor:    1
     Average block replication:    0.0
     Corrupt blocks:        1
     Missing replicas:        0
     Number of data-nodes:        1
     Number of racks:        1
    FSCK ended at Thu Sep 06 09:23:04 CST 2018 in 1 milliseconds
    
    
    The filesystem under path '/var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210' is CORRUPT

    步骤2,删除缺失文件

    hdfs fsck -delete blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    hdfs fsck -delete blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

    步骤3, 检查集群健康状况

  • 相关阅读:
    项目spring boot 写es hbase 运行内存溢出
    spring boot项目启动报错
    线程的创建启动及线程池的使用
    ajax 跨域问题处理
    spring @Value("${name}")使用
    平时服务正常,突然挂了,怎么重启都起不来,查看日志Insufficient space for shared memory file 内存文件空间不足
    oracle 特殊符号替换删除处理
    Linux——CentOS 7 systemctl和防火墙firewalld命令
    linux 查看并对外开放端口(防火墙拦截处理)
    SpringBoot 使用 Gson 序列化(禁用 Jackson)
  • 原文地址:https://www.cnblogs.com/itboys/p/9596441.html
Copyright © 2011-2022 走看看