zoukankan      html  css  js  c++  java
  • HDFS under replicated blocks

    under replicated blocks 
    解决:
    找出没有复制的block:
    hdfs fsck / | grep 'Under replicated' | awk -F':' '{print $1}' >> /tmp/under_replicated_files 
    然后循环修复:
    for hdfsfile in `cat /tmp/under_replicated_files`; do echo "Fixing $hdfsfile :" ;  hadoop fs -setrep 3 $hdfsfile; done
    输出如下:
    Fixing /user/hdfs/.staging/job_1547173493660_0405/job.jar :
    Replication 3 set: /user/hdfs/.staging/job_1547173493660_0405/job.jar
    Fixing /user/hdfs/.staging/job_1547173493660_0405/job.split :
    Replication 3 set: /user/hdfs/.staging/job_1547173493660_0405/job.split
    Fixing /user/hdfs/.staging/job_1547173493660_0481/job.jar :
    Replication 3 set: /user/hdfs/.staging/job_1547173493660_0481/job.jar
    Fixing /user/hdfs/.staging/job_1547173493660_0481/job.split :
    Replication 3 set: /user/hdfs/.staging/job_1547173493660_0481/job.split
    Fixing /user/hdfs/.staging/job_1547173493660_0483/job.jar :
    Replication 3 set: /user/hdfs/.staging/job_1547173493660_0483/job.jar
    Fixing /user/hdfs/.staging/job_1547173493660_0483/job.split :
    Replication 3 set: /user/hdfs/.staging/job_1547173493660_0483/job.split
    Fixing /user/hdfs/.staging/job_1547197402450_0021/job.jar :
    Replication 3 set: /user/hdfs/.staging/job_1547197402450_0021/job.jar
    Fixing /user/hdfs/.staging/job_1547197402450_0021/job.split :
    Replication 3 set: /user/hdfs/.staging/job_1547197402450_0021/job.split
  • 相关阅读:
    CSS 使DIV居中
    jsonlib 使用 转换JSON
    jquery autocomplete 自动完成 使用
    Sql server 实用技巧总结
    MvcHtml.DropDownList()用法
    日期时间正则表达式
    ASP.NET使用log4Net日志组件教程(每天产生一个日志及日志按大小切割)
    MvcHtml.ActionLink()用法
    给学弟的bitset使用整理
    2021 CCPC 广州站
  • 原文地址:https://www.cnblogs.com/shanhua-fu/p/11344790.html
Copyright © 2011-2022 走看看