zoukankan      html  css  js  c++  java
  • could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation.

    hdfs dfsadmin -report
    

    hadoop fsck -locations
    

     查看DataNode日志(vim  /usr/local/hadoop/logs/)

    2021-04-01 10:15:31,969 WARN org.apache.hadoop.hdfs.server.common.Storage: Failed to add storage directory [DISK]file:/usr/local/hadoop/tmp/dfs/data/
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /usr/local/hadoop/tmp/dfs/data is in an inconsistent state: Can't format the storage directory because the current directory is not empty.
            at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.checkEmptyCurrent(Storage.java:498)
            at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:603)
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:270)
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:409)
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:388)
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:564)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1659)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1620)
            at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:388)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:282)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:821)
            at java.lang.Thread.run(Thread.java:748)
    2021-04-01 10:15:31,971 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to Master/211.69.243.34:9000. Exiting.
    java.io.IOException: All specified directories have failed to load.
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:565)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1659)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1620)
            at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:388)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:282)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:821)
            at java.lang.Thread.run(Thread.java:748)
    2021-04-01 10:15:31,971 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to Master/211.69.243.34:9000
    2021-04-01 10:15:31,982 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool <registering> (Datanode Uuid unassigned)
    2021-04-01 10:15:33,982 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
    2021-04-01 10:15:33,988 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down DataNode at Master/211.69.243.34
    ************************************************************/
    

      

  • 相关阅读:
    LeetCode121.买卖股票的最佳时机
    OpenFunction 应用系列之一: 以 Serverless 的方式实现 Kubernetes 日志告警
    KubeSphere 核心架构浅析
    云原生爱好者周刊:服务网格的困境与破局
    DG:11.2.0.4 RAC在线duplicate恢复DG
    ORA-17629: Cannot connect to the remote database server
    DG:RFS[8]: No standby redo logfiles created for thread 2
    U盘内容不显示?U盘有文件却看不见?
    【CSS】特殊符号content编码及作为字体图标使用方法
    Python中的if __name__ == '__main__'(转载)
  • 原文地址:https://www.cnblogs.com/y-c-m520/p/14744134.html
Copyright © 2011-2022 走看看