zoukankan      html  css  js  c++  java
  • centos安装hdp

    1. 准备6和7的 YUM源包
    1.1 centos 下载后解压到同一个目录
    http://mirrors.163.com/centos/6/isos/x86_64/CentOS-6.9-x86_64-bin-DVD1.iso
    http://mirrors.163.com/centos/6/isos/x86_64/CentOS-6.9-x86_64-bin-DVD2.iso
    mount -o loop CentOS-6.9-x86_64-bin-DVD1.iso /mnt
    /bin/cp -r /mnt/* /data/mirrors/centos69/
    umount /mnt
    mount -o loop CentOS-6.9-x86_64-bin-DVD2.iso /mnt
    /bin/cp -r /mnt/* /data/mirrors/centos69/
    http://mirrors.163.com/centos/7/isos/x86_64/CentOS-7-x86_64-Everything-1611.iso
    1.2 epel
    https://mirrors.aliyun.com/epel/6/x86_64/
    https://mirrors.aliyun.com/epel/7/x86_64/
    http://centos.ustc.edu.cn/epel/6/x86_64/
    http://centos.ustc.edu.cn/epel/7/x86_64/

    1.3 ambari
    1.4 hdp
    见hdp6.repo 和 hdp7.repo
    1.5 hdp_utils
    见hdp6.repo 和 hdp7.repo

    2. 下载yum源包到本地
    mkdir mirrors
    yum repolist
    reposync -r epel6_x86_64

    3. 环境准备
    3.0 hosts setup
    3.1 ssh-keygen
    3.2 ssh-copy-id
    3.3 iptables
    chkconfig iptables off
    3.4 NetworkManager
    chkconfig NetworkManager off
    3.5 selinux
    cat /etc/sysconfig/selinux
    3.6 关闭THP
    3.7 设置最大打开文件
    /etc/security/limits.conf
    * soft nofile = 65536
    * hard nofile = 65536
    root soft nofile 65536
    root hard nofile 65536

    /etc/profile
    ulimit -n 65536

    3.8 JDK 自动下载即可
    3.9 NTP
    chkconfig ntpd on;service ntpd restart
    3.10 安装httpd服务,架设yum源
    service httpd start
    ln -s /data/mirrors /var/www/html/mirrors
    yum clean all
    yum makecache
    yum repolist
    3.11 安装base包
    yum install yum-utils createrepo mysql-connector-java httpd links openssh wget vim openssh-clients openssl gcc openssh-server mysql-connector-odbc -y


    4. ambari 安装

    5. HDP安装
    4.1 HA安装

    引用:
    http://www.yp14.cn/2016/12/09/Centos7-2%E5%AE%89%E8%A3%85Ambari2-4-2-HDP2-5-3%E6%90%AD%E5%BB%BAHadoop%E9%9B%86%E7%BE%A4/
    https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/hdp_25_repositories.html
    http://mirrors.163.com/centos/
    http://mirrors.aliyun.com/
    ftp://gmcc:gmcc@www.wangyougx.com
    ftp://gmcc:gmcc@www.wangyougx.com/sdi1/hadoop%B0%B2%D7%B0%B0%FC/ambari-2.5.1.0-centos6.tar.gz

    http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.2.0/ambari-2.4.2.0-centos6.tar.gz
    http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.4.2.0/ambari-2.4.2.0-centos7.tar.gz
    http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.3.0/HDP-2.5.3.0-centos6-rpm.tar.gz
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/HDP-UTILS-1.1.0.21-centos6.tar.gz
    http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.5.3.0/HDP-2.5.3.0-centos7-rpm.tar.gz
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7/HDP-UTILS-1.1.0.21-centos7.tar.gz
    http://centos.ustc.edu.cn/epel/6/x86_64/

  • 相关阅读:
    OpenStack 中的neutron-server启动过程
    NYOJ 284 坦克大战 【BFS】+【优先队列】
    HDSF主要节点解说(二)工作原理
    SQL SERVER中的流程控制语句
    Android 自己定义View (二) 进阶
    JNI学习积累之一 ---- 常用函数大全
    Android NDK开发之Jni的数据类型
    CMakeListx.txt 编辑语法学习
    用CMake代替makefile进行跨平台交叉编译
    Android 开发--CMakeList调用本地so文件
  • 原文地址:https://www.cnblogs.com/chenzechao/p/6915568.html
Copyright © 2011-2022 走看看