zoukankan      html  css  js  c++  java
  • Ambari安装Hadoop集群

    * System Environment:centOS6.7

    1.Prepare the Environment

      1)Set Up Password-less SSH : (Generate public and private SSH keys on the Ambari Server host.)

     cd ~  
    ssh-keygen

      will generate id_rsa  id_rsa.pub  under .ssh folder.

         Do the below command on Ambari server:

    cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys  

       Do command oneach target hosts:

     scp ~/.ssh/authorized_keys slave-1:/root/.ssh/  
    scp ~/.ssh/authorized_keys slave-2:/root/.ssh/  

      Do command on each host(include Ambari server)

    chmod 700 ~/.ssh  
    chmod 600 ~/.ssh/authorized_keys  

      From the Ambari Server, make sure you can connect to each host in the cluster using SSH, without having to enter a password. If the following warning message displays during your first connection:  Are you sure you want to continue

      connecting (yes/no)?  Enter  Yes .


       Note:It is possible to use a non-root SSH account, if that account can execute  sudowithout entering a password.

      2) Enable NTP on the Cluster and on the Browser Host

    chkconfig --list ntpd
    chkconfig ntpd on
    service ntpd start

      3) Check DNS and NSCD

      3.1) HostName

      Add a line for each host in your cluster. The line should consist of the IP address and the FQDN

    vi /etc/hosts

      Use the "hostname" command to set the hostname on each host in your cluster. Fo example:

       Confirm that the hostname is set by running the following command:

    hostname -f

      This should return the <fully.qualified.domain.name> you just set. e.g:

      3.2)Edit the Network Configuration File

    vi /etc/sysconfig/network

       Modify the HOSTNAME property to set the fully qualified domain name.

    NETWORKING=yes
    HOSTNAME=Master

       3.3)Configuring iptables

    chkconfig iptables off
    /etc/init.d/iptables stop

      3.4) Disable SELinux and PackageKit and check the umask Value

    setenforce 0
     vi /etc/selinux/config
    vi /etc/yum/pluginconf.d/refresh-packagekit.conf

     umask 0022
     echo umask 0022 >> /etc/profile

    Okay. Now .You finished the environment prepared.

    Let's begin to install Ambari.

    Step1: Download the Ambari repository on the Ambari Server host

    cd /etc/yum.repos.d/
    wget http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.2.1.0/ambari.repo

    Step 2: Install, Setup, and Start Ambari Server

    yum install ambari-server
    ambari-server setup
    ambari-server start
    Step 3: Deploy Cluster using Ambari Web UI 

    Open up a web browser and go to http://<ambari-server-host>:8080.

    相关参考:

    1.安装ambari:

    https://cwiki.apache.org/confluence/display/AMBARI/Install+Ambari+2.2.1+from+Public+Repositories

    http://hortonworks.com/hdp/downloads/#hdf

    http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.1/bk_ambari_reference_guide/content/index.html

    2. 安装 agent问题 解决 

    http://blog.csdn.net/shiqidide/article/details/18361203

    http://linux.it.net.cn/e/cluster/hadoop/2015/1007/17607.html

    3.删除用户 等

    http://geniuszhe.blog.163.com/blog/static/11934682013111984718679/

    4.解决issue:

    解决办法,在Linux下执行:

    echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
    
    echo never > /sys/kernel/mm/redhat_transparent_hugepage/enabled
    
    echo never > /sys/kernel/mm/transparent_hugepage/enabled
    
    echo never > /sys/kernel/mm/transparent_hugepage/defrag
  • 相关阅读:
    2016去哪儿编程题:乘坐公交
    lintcode:交错正负数
    lintcode:Ugly Number I
    KMP算法
    适配器模式
    迭代器模式
    命令模式
    外观模式
    工厂方法模式
    代理模式
  • 原文地址:https://www.cnblogs.com/sos-blue/p/5332042.html
Copyright © 2011-2022 走看看