zoukankan      html  css  js  c++  java
  • 升级ambari、HDP版本(ambari 2.1升级到2.4、HDP2.3升级到2.5)

    转载自:http://blog.csdn.net/levy_cui/article/details/52461377

    官方升级版本说明
    http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.0.1/bk_ambari-installation/content/determine_stack_compatibility.html

    官方升级步骤
    http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.0.1/bk_ambari-upgrade/content/preparing_to_upgrade_ambari.html

    官方HDP问题搜索
    https://community.hortonworks.com/answers/index.html

    Upgrade Ambari

    一、升级前准备

    Preparing to Upgrade

    确认版本
    Be sure to review the Release Notes for this Ambari release for Known Issues and Behavioral Changes.

    拥有root权限
    You must have root, administrative, or root-equivalent authorization on the Ambari server host and all servers in the cluster.

    备份ambari数据库
    You must backup the Ambari Server database.

    备份好ambari.properties配置文件
    You must make a safe copy of the Ambari Server configuration file found at /etc/ambari-server/conf/ambari.properties.


    二、停止服务、下载新的ambari.repo

    关闭Ambari Metrics
    If you are running Ambari Metrics service in your cluster, stop the service. From Ambari Web, browse to Services > Ambari Metrics and select Stop from the Service Actions menu.
        
    停止ambari-server
    Stop the Ambari Server. On the host running Ambari Server:
        ambari-server stop

    停止ambari-agent
    Stop all Ambari Agents. On each host in your cluster running an Ambari Agent:
        ambari-agent stop

    获取新的ambari.repo
    Fetch the new Ambari repo and replace the old repository file with the new repository file on all hosts in your cluster.

    wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.0.1/ambari.repo -O /etc/yum.repos.d/ambari.repo

    三、升级操作
    Upgrade Ambari Server. On the host running Ambari Server:

        yum clean all
        yum info ambari-server

    在ambari节点更新ambari-server
    In the info output, visually validate that there is an available version containing "2.4"
        yum upgrade ambari-server

    显示如下成功:
    Updated:
       ambari-server.x86_64 0:2.4.0.1-1      
    Complete!

    在所有节点更新ambari-agent
    Upgrade all Ambari Agents. On each host in your cluster running an Ambari Agent:
        yum upgrade ambari-agent

    显示如下成功:
    Updated:
      ambari-agent.x86_64 0:2.4.0.1-1                                                         

    Complete!

    查看ambari-agent
    After the upgrade process completes, check each host to make sure the new files have been installed:
    rpm -qa | grep ambari-agent

    升级ambari-server
    Upgrade Ambari Server database schema. On the host running Ambari Server:
    ambari-server upgrade

    [root@testserver2 yum.repos.d]# ambari-server upgrade
    Using python  /usr/bin/python
    Upgrading ambari-server
    Updating properties in ambari.properties ...
    WARNING: Can not find ambari.properties.rpmsave file from previous version, skipping import of settings
    INFO: Can not find ambari-env.sh.rpmsave file from previous version, skipping restore of environment settings. ambari-env.sh may not include any user customization.
    Fixing database objects owner
    Ambari Server configured for Embedded Postgres. Confirm you have made a backup of the Ambari Server database [y/n] (y)?
    Upgrading database schema
    Adjusting ambari-server permissions and ownership...
    Ambari Server 'upgrade' completed successfully.

    启动ambari-server
    Start the Ambari Server. On the host running Ambari Server:
    ambari-server start

    [root@testserver2 yum.repos.d]# ambari-server start
    Using python  /usr/bin/python
    Starting ambari-server
    Ambari Server running with administrator privileges.
    Organizing resource files at /var/lib/ambari-server/resources...
    Ambari database consistency check started...
    No errors were found.
    Ambari database consistency check finished
    Server PID at: /var/run/ambari-server/ambari-server.pid
    Server out at: /var/log/ambari-server/ambari-server.out
    Server log at: /var/log/ambari-server/ambari-server.log
    Waiting for server start....................
    Ambari Server 'start' completed successfully.

    所有节点启动ambari-agent
    Start all Ambari Agents. On each host in your cluster running an Ambari Agent:
    ambari-agent start

    登录ambari管理界面,查看版本,升级成功。

    打开管理界面后出现图中内容,使用’ctrl+shift+R’刷新下就好了。


    四、增加新版本HDP

    浏览Ambari Web > Admin > Stack and Versions.

    点击Versions标签,你将看到已经安装的HDP版本

    如果看不到已经安装(Current)的版本, 说明客户端没有更新完。

    Admin > Manager Ambari > 左侧Versions
    点击右上角的按钮Register Version,添加新的hdp版本。

    8. 点击Install Packages就能够将hadoop升级到该HDP版本了。

    安装后点击upgrade,有两种升级模式,一种是保持服务运行升级,另一种是停止服务升级,后者升级更快些

     

    点击Checks查看警告信息,需要检查TEZ服务,进入TEZ服务,选择“”run service check“”

    提示是否升级

    选择i have performed the clients will retry on their above. 之后proceed

    开始升级,我选择的是停止服务升级,过程中会自动stop服务,有时候需要retry

    最后确认是否完成升级,升级后无法回退到旧版本。

    HDP2.5已经为当前版本

    在添加新服务的时候已经是新版本组件了

    看了下hdfs中的数据还在

     

    总结:

    对于生产环境hadoop集群升级,绝对是个重量级工作,一定要有敬畏之心,以上升级步骤虽然看着不复杂,也很顺利的完成,我是在测试环境上进行的,没有一点心理负担,

    如果是生产环境,不仅需要停止服务,如果在过程中出现问题,后果肯定无法想象,新版本组件也需要在升级前进行测试,业务是否可以运行正常,需要大量的测试实践工作,建议如果真要升级hadoop集群,还是考虑异地备份重要数据,避免数据丢失,比起数据丢失的风险,多买几台服务器进行数据备份,不算什么的,总之不到万不得已,轻易不要升级集群。

  • 相关阅读:
    div标签的闭合检查
    jquery easyui 显示和关闭数据加载的遮罩
    codeforces 446A DZY Loves Sequences
    android高速开发框架xUtils
    Android-spinner
    遗传算法优化策略
    面向对象的勾勾画画
    Android studio 解决setText中文乱码问题
    CAS—改动默认登录页
    android 使用post 提交
  • 原文地址:https://www.cnblogs.com/yangcx666/p/8723774.html
Copyright © 2011-2022 走看看