zoukankan      html  css  js  c++  java
  • 【异常】org.apache.hadoop.hdfs.server.common.InconsistentFSStateException

    1 异常信息

    05-30 07:53:45,204 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Maximum size of an xattr: 16384
    2019-05-30 07:53:45,204 WARN org.apache.hadoop.hdfs.server.common.Storage: Storage directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name does not exist
    2019-05-30 07:53:45,223 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Encountered exception loading fsimage
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:377)
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:228)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
    2019-05-30 07:53:45,272 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
    2019-05-30 07:53:45,273 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
    2019-05-30 07:53:45,274 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
    2019-05-30 07:53:45,274 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.
    2019-05-30 07:53:45,274 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:377)
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:228)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
    2019-05-30 07:53:45,275 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
    2019-05-30 07:53:45,279 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1
    ************************************************************/

    2 原因

      因为core-site.xml 和 hdfs-site.xml配置了不一致的Hadoop.tmp.dir 目录,导致总是出现问题,删除掉core-site.xml中的tmp.dir配置,统一配置到hdfs-site.xml中

      hdfs-site.xml中的dir配置

    <property>
            <name>dfs.namenode.name.dir</name>
            <value>file:///mnt/software/hadoop-2.6.0-cdh5.16.1/data/dfs/name</value>
        </property>
        <property>
            <name>dfs.datanode.data.dir</name>
            <value>file:///mnt/software/hadoop-2.6.0-cdh5.16.1/data/dfs/data</value>
        </property>
    

      

  • 相关阅读:
    Python实现天数倒计时计算
    pandas 的数据结构Series与DataFrame
    在python中使用静态方法staticmethod
    python 中对list做减法操作
    推荐系统之 BPR 算法及 Librec的BPR算法实现【1】
    机器学习中的 ground truth
    PyCharm 默认运行 unittest
    Python的copy()与deepcopy()区别
    MySQL中Decimal类型和Float Double的区别 & BigDecimal与Double使用场景
    Spring Boot 返回 JSON 数据,一分钟搞定!
  • 原文地址:https://www.cnblogs.com/QuestionsZhang/p/10952101.html
Copyright © 2011-2022 走看看