zoukankan      html  css  js  c++  java
  • 【异常】org.apache.hadoop.hdfs.server.common.InconsistentFSStateException

    1 异常信息

    05-30 07:53:45,204 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Maximum size of an xattr: 16384
    2019-05-30 07:53:45,204 WARN org.apache.hadoop.hdfs.server.common.Storage: Storage directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name does not exist
    2019-05-30 07:53:45,223 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Encountered exception loading fsimage
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:377)
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:228)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
    2019-05-30 07:53:45,272 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
    2019-05-30 07:53:45,273 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
    2019-05-30 07:53:45,274 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
    2019-05-30 07:53:45,274 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.
    2019-05-30 07:53:45,274 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:377)
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:228)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
    2019-05-30 07:53:45,275 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
    2019-05-30 07:53:45,279 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1
    ************************************************************/

    2 原因

      因为core-site.xml 和 hdfs-site.xml配置了不一致的Hadoop.tmp.dir 目录,导致总是出现问题,删除掉core-site.xml中的tmp.dir配置,统一配置到hdfs-site.xml中

      hdfs-site.xml中的dir配置

    <property>
            <name>dfs.namenode.name.dir</name>
            <value>file:///mnt/software/hadoop-2.6.0-cdh5.16.1/data/dfs/name</value>
        </property>
        <property>
            <name>dfs.datanode.data.dir</name>
            <value>file:///mnt/software/hadoop-2.6.0-cdh5.16.1/data/dfs/data</value>
        </property>
    

      

  • 相关阅读:
    日志组件logback的介绍及配置使用方法(二)
    日志组件logback的介绍及配置使用方法(一)
    MyBatis+MySQL 返回插入的主键ID
    基于shiro-cas的单点登录、单点登出、统一认证授权系统
    使用Redis存储Nginx+Tomcat负载均衡集群的Session
    数字转大写钱币
    世界四大汽车生产公司
    强制登陆远程桌面
    sql 获取连续年份
    SQL 递归
  • 原文地址:https://www.cnblogs.com/QuestionsZhang/p/10952101.html
Copyright © 2011-2022 走看看