zoukankan      html  css  js  c++  java
  • There are 2 missing blocks. The following files may be corrupted

    There are 2 missing blocks. The following files may be corrupted:

    步骤1,检查文件缺失情况

    可以看到, 

    blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

    确实各自都丢失了1个Block, 文件已经损坏,不可恢复。

    [root@master66 datacollectors]# hdfs fsck /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    Connecting to namenode via http://master66:50070
    FSCK started by root (auth:SIMPLE) from /10.3.70.116 for path /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210 at Thu Sep 06 09:23:04 CST 2018
    .
    /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: CORRUPT blockpool BP-1198174473-10.17.139.66-1492053574238 block blk_1074785806
    
    /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: MISSING 1 blocks of total size 41235 B.Status: CORRUPT
     Total size:    41235 B
     Total dirs:    0
     Total files:    1
     Total symlinks:        0
     Total blocks (validated):    1 (avg. block size 41235 B)
      ********************************
      CORRUPT FILES:    1
      MISSING BLOCKS:    1
      MISSING SIZE:        41235 B
      CORRUPT BLOCKS:     1
      ********************************
     Minimally replicated blocks:    0 (0.0 %)
     Over-replicated blocks:    0 (0.0 %)
     Under-replicated blocks:    0 (0.0 %)
     Mis-replicated blocks:        0 (0.0 %)
     Default replication factor:    1
     Average block replication:    0.0
     Corrupt blocks:        1
     Missing replicas:        0
     Number of data-nodes:        1
     Number of racks:        1
    FSCK ended at Thu Sep 06 09:23:04 CST 2018 in 1 milliseconds
    
    
    The filesystem under path '/var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210' is CORRUPT

    步骤2,删除缺失文件

    hdfs fsck -delete blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
    hdfs fsck -delete blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

    步骤3, 检查集群健康状况

  • 相关阅读:
    ASP.NET26 个常用性能优化方法
    git 合并 二进制文件
    git 状态管理
    git 分支管理,提交到远程服务器上面
    git 发布android 系统版本 修改版本型号 查看指定文件的修改记录
    使用git 发布android系统版本 1
    提取文本当中的汉字
    wpf 命名空间中不存在
    c# 调用c DLL 所传参数不正确
    用于主题检测的临时日志(233d1263-3c3c-43d0-a2fd-318ee6fd58db
  • 原文地址:https://www.cnblogs.com/itboys/p/9596441.html
Copyright © 2011-2022 走看看