zoukankan      html  css  js  c++  java
  • hadoop2.3.0cdh5.0.2 升级到cdh5.7.0

    后儿就放假了,上班这心真心收不住,为了能充实的度过这难熬的两天,我决定搞个大工程。。。。。ps:我为啥这么期待放假呢,在沙发上像死人一样躺一天真的有意义嘛。。。。。。。

    当然版本:hadoop2.3.0cdh5.0.2

    机器:

      nn dn jn rm nm jh hmaster hregionserver
    mast1  
    mast2  
    mast3      

    目标版本:hadoop2.6.0cdh5.7.0

    升级方式:Upgrading Unmanaged CDH Using the Command Line

    升级注意事项:①从低于cdh5.4.0升级到cdh5.4.0或更高版本,需要进行hdfs元数据升级;

                        ②从低于cdh5.2.0版本升级需要做如下升级:升级hdfs元数据

                                                                                  升级Sentry database

                                                                                  升级hive数据库

                                                                                  升级sqoop2数据库

                        ③另外还要确保如下升级:升级Oozie数据库和共享数据库

                                                          如果向hdfs上传了spark集合jar文件,要上传文件的最新版本

    升级步骤:

           1.为升级做准备:

              ①使namenode进入安全模式,备份fsimage

            [hadoop@mast1 conf]$ hdfs haadmin -getServiceState mast1

            active

            [hadoop@mast1 conf]$ hdfs dfsadmin -safemode enter

            Safe mode is ON

            [hadoop@mast1 conf]$ hdfs dfsadmin -saveNamespace

             ②确认无hadoop服务在运行

              [root@mast1 ~]# ps -aef|grep java

              root       9540   8838  0 15:34 pts/0    00:00:00 grep java

             ③在namenode(ha中active的namenode)中备份元数据(注意过程中如果发现lock文件,则从头开始再执行一遍)       

    [root@mast1 ~]# cd /app/hdp/dfs/name

    [root@mast1 name]# tar -cvf /root/nn_backup_data.tar .

    ./

    ./edits/

    ./edits/current/

    ./edits/current/edits_inprogress_0000000000000000624

    ./edits/current/edits_0000000000000000413-0000000000000000533

    ./edits/current/edits_0000000000000000620-0000000000000000621

    ./edits/current/edits_0000000000000000618-0000000000000000619

    ./edits/current/edits_0000000000000000062-0000000000000000180

    ./edits/current/edits_0000000000000000622-0000000000000000623

    ./edits/current/edits_0000000000000000038-0000000000000000050

    ./edits/current/edits_0000000000000000534-0000000000000000615

    ./edits/current/edits_0000000000000000181-0000000000000000182

    ./edits/current/edits_0000000000000000284-0000000000000000412

    ./edits/current/edits_0000000000000000051-0000000000000000061

    ./edits/current/seen_txid

    ./edits/current/edits_0000000000000000183-0000000000000000283

    ./edits/current/VERSION

    ./edits/current/edits_0000000000000000616-0000000000000000617

    ./current/

    ./current/fsimage_0000000000000000000

    ./current/seen_txid

    ./current/VERSION

    ./current/fsimage_0000000000000000000.md5

    ./namesecondary/

        2.下载CDH 5 "1-click" repository

        https://archive.cloudera.com/cdh5/one-click-install/redhat/6/x86_64/cloudera-cdh-5-0.x86_64.rpm

        3.更新

  • 相关阅读:
    运维实战:两台服务器http方式共享yum软件仓库
    初始化thinkphp6.0出现的问题解决
    记一次续签SSL证书导致微信小程序部分机型无法访问网站接口
    微信小程序-订阅消息验证发送值有效格式
    微信小程序分包优化
    MySQL timeout 参数详解
    mysql 事件
    springboot 远程拉取配置中心配置
    使用springboot的resttmplate请求远程服务的时候报 403问题
    for 循环 与增强的for循环 经验小结
  • 原文地址:https://www.cnblogs.com/roger888/p/5567292.html
Copyright © 2011-2022 走看看