zoukankan      html  css  js  c++  java
  • Datanode启动问题 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering>

    2017-04-15 21:21:15,423 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: supergroup = supergroup
    2017-04-15 21:21:15,467 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 1000
    2017-04-15 21:21:15,486 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50020
    2017-04-15 21:21:15,511 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened IPC server at /0.0.0.0:50020
    2017-04-15 21:21:15,521 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Refresh request received for nameservices: mycluster
    2017-04-15 21:21:15,551 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting BPOfferServices for nameservices: mycluster
    2017-04-15 21:21:15,559 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to hdp265m.test.com/192.168.56.104:53310 starting to offer service
    2017-04-15 21:21:15,573 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to hdp265m2.test.com/192.168.56.107:53310 starting to offer service
    2017-04-15 21:21:15,585 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
    2017-04-15 21:21:15,586 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 50020: starting
    2017-04-15 21:21:15,903 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hdp/hadoop/data/in_use.lock acquired by nodename 12483@hdp265s1.test.com
    2017-04-15 21:21:15,904 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /home/hdp/hadoop/data: namenode clusterID = CID-bf7ff1f1-680c-4bbf-958b-bda65fb409de; datanode clusterID = c1
    2017-04-15 21:21:15,951 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hdp/hadoop/data/in_use.lock acquired by nodename 12483@hdp265s1.test.com
    2017-04-15 21:21:15,952 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /home/hdp/hadoop/data: namenode clusterID = CID-bf7ff1f1-680c-4bbf-958b-bda65fb409de; datanode clusterID = c1
    2017-04-15 21:21:15,952 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to hdp265m2.test.com/192.168.56.107:53310. Exiting.
    java.io.IOException: All specified directories are failed to load.
            at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:478)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1342)
            at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1308)
            at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:314)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:226)
            at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:867)
            at java.lang.Thread.run(Thread.java:745)

    原因是clusterID不一致

    删除tmp下的内容

    从/home/hdp/hadoop/name/current/VERSION 获得clusterID

    修改到

    /home/hdp/hadoop/data/current/VERSION

    修改保持一致,然后重启服务

  • 相关阅读:
    Docker集群实验环境布署--swarm【4 管理组件--manager】
    Docker集群实验环境布署--swarm【3 注册服务监控与自动发现组件--consul】
    Docker集群实验环境布署--swarm【2 搭建本地镜像仓库】
    Docker集群实验环境布署--swarm【1 架构说明】
    zabbix 布署实践【7 H3C网络设备监控模版制作思路】
    zabbix 布署实践【6 使用微信公众号-消息模版推送告警】
    zabbix 布署实践【5 使用邮箱SMTP SSL推送告警邮件】
    zabbix 布署实践【4 服务器自动探索发现,并且自动关联模版】
    openstack私有云布署实践【19 通过python客户端 创建实例VM指定IP地址】
    openstack私有云布署实践【18 修改实例DHCP服务的DNS IP】
  • 原文地址:https://www.cnblogs.com/dadadechengzi/p/6715843.html
Copyright © 2011-2022 走看看