zoukankan      html  css  js  c++  java
  • There are 2 missing blocks. The following files may be corrupted

    There are 2 missing blocks. The following files may be corrupted:

    步骤1,检查文件缺失情况

    可以看到, 

    blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

    确实各自都丢失了1个Block, 文件已经损坏,不可恢复。

    [root@master66 datacollectors]# hdfs fsck /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    Connecting to namenode via http://master66:50070
    FSCK started by root (auth:SIMPLE) from /10.3.70.116 for path /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210 at Thu Sep 06 09:23:04 CST 2018
    .
    /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: CORRUPT blockpool BP-1198174473-10.17.139.66-1492053574238 block blk_1074785806
    
    /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: MISSING 1 blocks of total size 41235 B.Status: CORRUPT
     Total size:    41235 B
     Total dirs:    0
     Total files:    1
     Total symlinks:        0
     Total blocks (validated):    1 (avg. block size 41235 B)
      ********************************
      CORRUPT FILES:    1
      MISSING BLOCKS:    1
      MISSING SIZE:        41235 B
      CORRUPT BLOCKS:     1
      ********************************
     Minimally replicated blocks:    0 (0.0 %)
     Over-replicated blocks:    0 (0.0 %)
     Under-replicated blocks:    0 (0.0 %)
     Mis-replicated blocks:        0 (0.0 %)
     Default replication factor:    1
     Average block replication:    0.0
     Corrupt blocks:        1
     Missing replicas:        0
     Number of data-nodes:        1
     Number of racks:        1
    FSCK ended at Thu Sep 06 09:23:04 CST 2018 in 1 milliseconds
    
    
    The filesystem under path '/var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210' is CORRUPT

    步骤2,删除缺失文件

    hdfs fsck -delete blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    hdfs fsck -delete blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

    步骤3, 检查集群健康状况

  • 相关阅读:
    Hibernate动态更新
    Spring MVC实现文件上传
    windows 常用命名
    有用的SQL查询
    SQL语句、EF DataAnnotation和EF Fluent API方式创建联合主键
    EF6学习笔记三十二:性能优化——实体缓存和翻译缓存
    EF6学习笔记三十一:性能优化(二)
    EF6学习笔记三十:性能优化——预编译视图
    EF6学习笔记二十九:并发冲突(三)
    EF6学习笔记二十八:并发冲突(二)
  • 原文地址:https://www.cnblogs.com/itboys/p/9596441.html
Copyright © 2011-2022 走看看