zoukankan      html  css  js  c++  java
  • centos安装hdp

    1. 准备6和7的 YUM源包
    1.1 centos 下载后解压到同一个目录
    http://mirrors.163.com/centos/6/isos/x86_64/CentOS-6.9-x86_64-bin-DVD1.iso
    http://mirrors.163.com/centos/6/isos/x86_64/CentOS-6.9-x86_64-bin-DVD2.iso
    mount -o loop CentOS-6.9-x86_64-bin-DVD1.iso /mnt
    /bin/cp -r /mnt/* /data/mirrors/centos69/
    umount /mnt
    mount -o loop CentOS-6.9-x86_64-bin-DVD2.iso /mnt
    /bin/cp -r /mnt/* /data/mirrors/centos69/
    http://mirrors.163.com/centos/7/isos/x86_64/CentOS-7-x86_64-Everything-1611.iso
    1.2 epel
    https://mirrors.aliyun.com/epel/6/x86_64/
    https://mirrors.aliyun.com/epel/7/x86_64/
    http://centos.ustc.edu.cn/epel/6/x86_64/
    http://centos.ustc.edu.cn/epel/7/x86_64/

    1.3 ambari
    1.4 hdp
    见hdp6.repo 和 hdp7.repo
    1.5 hdp_utils
    见hdp6.repo 和 hdp7.repo

    2. 下载yum源包到本地
    mkdir mirrors
    yum repolist
    reposync -r epel6_x86_64

    3. 环境准备
    3.0 hosts setup
    3.1 ssh-keygen
    3.2 ssh-copy-id
    3.3 iptables
    chkconfig iptables off
    3.4 NetworkManager
    chkconfig NetworkManager off
    3.5 selinux
    cat /etc/sysconfig/selinux
    3.6 关闭THP
    3.7 设置最大打开文件
    /etc/security/limits.conf
    * soft nofile = 65536
    * hard nofile = 65536
    root soft nofile 65536
    root hard nofile 65536

    /etc/profile
    ulimit -n 65536

    3.8 JDK 自动下载即可
    3.9 NTP
    chkconfig ntpd on;service ntpd restart
    3.10 安装httpd服务,架设yum源
    service httpd start
    ln -s /data/mirrors /var/www/html/mirrors
    yum clean all
    yum makecache
    yum repolist
    3.11 安装base包
    yum install yum-utils createrepo mysql-connector-java httpd links openssh wget vim openssh-clients openssl gcc openssh-server mysql-connector-odbc -y


    4. ambari 安装

    5. HDP安装
    4.1 HA安装

    引用:
    http://www.yp14.cn/2016/12/09/Centos7-2%E5%AE%89%E8%A3%85Ambari2-4-2-HDP2-5-3%E6%90%AD%E5%BB%BAHadoop%E9%9B%86%E7%BE%A4/
    https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/hdp_25_repositories.html
    http://mirrors.163.com/centos/
    http://mirrors.aliyun.com/
    ftp://gmcc:gmcc@www.wangyougx.com
    ftp://gmcc:gmcc@www.wangyougx.com/sdi1/hadoop%B0%B2%D7%B0%B0%FC/ambari-2.5.1.0-centos6.tar.gz

    http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.2.0/ambari-2.4.2.0-centos6.tar.gz
    http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.4.2.0/ambari-2.4.2.0-centos7.tar.gz
    http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.3.0/HDP-2.5.3.0-centos6-rpm.tar.gz
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/HDP-UTILS-1.1.0.21-centos6.tar.gz
    http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.5.3.0/HDP-2.5.3.0-centos7-rpm.tar.gz
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7/HDP-UTILS-1.1.0.21-centos7.tar.gz
    http://centos.ustc.edu.cn/epel/6/x86_64/

  • 相关阅读:
    基于Grafana+SimpleJson的灵活报表解决方案
    Scala安装时的坑
    Windows批量添加防火墙例外端口
    VMware与Hyper-V
    InfluxDB:cannot use field in group by clause
    .Net版InfluxDB客户端使用时的一些坑
    KafkaManager中Group下不显示对应Topic的解决方案
    Linux下查看Go语言软件运行情况
    Flink升级到1.4版本遇到的坑
    spring cloud(一)带你进入分布式
  • 原文地址:https://www.cnblogs.com/chenzechao/p/6915568.html
Copyright © 2011-2022 走看看