zoukankan      html  css  js  c++  java
  • hadoop 集群 master datanode 没有启动


    2018-02-07 02:47:50,377 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /opt/app/hadoop-2.5.0/data/temp/dfs/data: namenode clusterID = CID-e36bedae-9a49-49cc-99bb-fc0bab2397c6; datanode clusterID = CID-39879bff-87ca-4127-ba35-d3ba57188748 2018-02-07 02:47:50,378 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to master/192.168.80.130:8020. Exiting. java.io.IOException: All specified directories are failed to load. at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:477) at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1322) at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1292) at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:321) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:225) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:862) at java.lang.Thread.run(Thread.java:748) 2018-02-07 02:47:50,387 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to master/192.168.80.130:8020 2018-02-07 02:47:50,391 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool <registering> (Datanode Uuid unassigned) 2018-02-07 02:47:52,392 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode 2018-02-07 02:47:52,394 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0 2018-02-07 02:47:52,399 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
    • 启动hadoop 集群时候发现master datanode 没有启动 查看日志发现是datanode 和namenode 的集群ID 不一样
    • 然后将namenode的集群ID 复制到 dadanode 集群
    • cd /data/temp/data/ 
    • vim VERSION
    • storageID=DS-26514c3d-3305-4468-b555-8e3a0c3e8316
      clusterID=CID-39879bff-87ca-4127-ba35-d3ba57188748-->修改这个
      cTime=0
      datanodeUuid=61ad9229-5274-44eb-8585-37f2ce4933c9
      storageType=DATA_NODE
      layoutVersion=-56

    一起交流进步.扫描下方QQ二维码即可

  • 相关阅读:
    HTML中的target(_self,_blank)用法总结
    实用且不花哨的js代码大全
    C#操作Excel文件暨C#实现在Excel中将连续多列相同数据项合并
    ASP.NET操作EXCEL
    sql分页存储过程(汇总)
    Jquery plugin(多文件上传)
    使用 Anthem.NET 的常见回调(Callback)处理方式小结
    NET开发人员必知的八个网站
    用jQuery合并表格中相同文本的相邻单元格(一)
    Sigma Grid(纯javascript开发的Ajax数据表格,超级强大)
  • 原文地址:https://www.cnblogs.com/bj-xiaodao/p/8428070.html
Copyright © 2011-2022 走看看