zoukankan      html  css  js  c++  java
  • 多次format namenode后,datanode无法正常启动

    DataNode报错日志如下:

    2021-07-05 16:30:53,595 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to test-hadoop-2-21/192.168.2.21:8020. Exiting. 
    java.io.IOException: All specified directories are failed to load.
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:477)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1361)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1326)
            at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:316)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:223)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:801)
            at java.lang.Thread.run(Thread.java:748)
    2021-07-05 16:30:53,597 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to test-hadoop-2-21/192.168.2.21:8020
    2021-07-05 16:30:53,595 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to test-hadoop-2-22/192.168.2.22:8020. Exiting. 
    java.io.IOException: Cluster IDs not matched: dn cid=CID-ae173266-e1e1-4871-9b15-f29a7c16e302 but ns cid=CID-0a73391e-ebcc-42ca-99a6-1454d873bb5e; bpid=BP-1650383988-192.168.2.22-1625473706063
            at org.apache.hadoop.hdfs.server.datanode.DataNode.setClusterId(DataNode.java:717)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1319)
            at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:316)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:223)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:801)
            at java.lang.Thread.run(Thread.java:748)
    2021-07-05 16:30:53,598 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to test-hadoop-2-22/192.168.2.22:8020
    2021-07-05 16:30:53,699 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool <registering> (Datanode Uuid unassigned)
    2021-07-05 16:30:55,699 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
    2021-07-05 16:30:55,701 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0
    2021-07-05 16:30:55,703 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: 

    DataNode无法正常启动的话,可以先删除对应的 /xxxx/dfs/data/current 目录  因为version版本不一致导致启动失败。删除成功后,然后重启DataNode。发现重启成功。

    然后访问hadoop namenode节点50070端口,发现active和standby节点展示DataNode节点不一样(或者有其中一个直接不展示),则需要同步namenode节点信息保持一致。

    如果是在hadoop01节点执行的格式化操作:hdfs namenode -format ,则需要在另一台namenode节点执行同步:hdfs namenode -bootstrapStandby

    参考:

    https://blog.csdn.net/QMW19910301/article/details/78055601

    https://blog.51cto.com/hsbxxl/2066487

  • 相关阅读:
    设计模式学习笔记——Bridge 桥接模式
    设计模式学习笔记——Adapter 适配器模式
    protoc protobuff安装
    docker-compose启动consul
    docker etcd 环境搭建
    nifi的去重方案设计(二)-外部存储mysql全局去重
    实现一套ES全文检索语法-到Lucene语法的转换工具,以实现在es外部兼容处理文本分词
    nifi的去重方案设计(一)-单队列内去重.md
    k8s 证书过期处理
    部分项目从kafka迁移至pulsar,近期使用中碰到了一些问题,勉强把大的坑踩完了,topic永驻,性能相关
  • 原文地址:https://www.cnblogs.com/-courage/p/14973725.html
Copyright © 2011-2022 走看看