zoukankan      html  css  js  c++  java
  • AWS安装CDH5.3-CentOS6.4

    1.下载CM启动文件

    [root@ip-172-31-23-107 ec2-user]# wget http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin

    --2015-01-26 14:25:42--  http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin

    Resolving archive.cloudera.com... 54.230.71.55, 54.240.188.97, 54.230.68.13, ...

    Connecting to archive.cloudera.com|54.230.71.55|:80... connected.

    HTTP request sent, awaiting response... 200 OK

    Length: 514295 (502K) [application/octet-stream]

    Saving to: `cloudera-manager-installer.bin'

     

    100%[================================================================================================================================================================>] 514,295     --.-K/s   in 0.06s   

     

    2015-01-26 14:25:42 (8.75 MB/s) - `cloudera-manager-installer.bin' saved [514295/514295]

     

    2. 关闭SELINX

    [root@ip-172-31-23-107 ec2-user]# vi /etc/selinux/config

    # This file controls the state of SELinux on the system.

    # SELINUX= can take one of these three values:

    #       enforcing - SELinux security policy is enforced.

    #       permissive - SELinux prints warnings instead of enforcing.

    #       disabled - SELinux is fully disabled.

    SELINUX=disabled

    # SELINUXTYPE= type of policy in use. Possible values are:

    #       targeted - Only targeted network daemons are protected.

    #       strict - Full SELinux protection.

    SELINUXTYPE=targeted

    3.关闭防火墙

    [root@ip-172-31-23-107 ec2-user]# chkconfig iptables off 

    4.重启服务器,使2-3步修改生效 

    5.安装

    修改cloudera-manager-installer.bin的权限,并以root用户执行

    发生错误,查看日志:

    [root@ip-10-248-41-177 ec2-user]# vi /var/log/cloudera-manager-installer/2.install-oracle-j2sdk1.7.log 

     

    Failed to set locale, defaulting to C

    Loaded plugins: fastestmirror, security

    Determining fastest mirrors

    Error: Cannot retrieve metalink for repository: epel. Please verify its path and try again

     

    修改文件“/etc/yum.repos.d/epel.repo”, 将baseurl的注释取消, mirrorlist注释掉。即可。

    5.安装向导走完。最好进入CM界面:54.187.193.80:7180

     

    6.在CM界面中遇到ec2-user的问题,


      • Edit the /etc/ssh/sshd_config file and change the line that says “PermitRootLogin forced-commands-only” to “PermitRootLogin without-password”.
      • Restart the sshd server with “service sshd restart”.
      • Edit the /root/.ssh/authorized_keys file. This file should have one line only. It starts by “echo” or “command … sleep 10;” then you can see “ssh-rsa [big long key]”. Remove the text from the beginning of the line until where it says “ssh-rsa”.

    [root@ip-10-248-41-177 ec2-user]# vi /etc/ssh/sshd_config

    #PermitRootLogin yes  -->

    PermitRootLogin without-password

    [root@ip-10-248-41-177 ec2-user]# /etc/init.d/sshd reload

    [root@ip-10-248-41-177 ec2-user]# vi ~/.ssh/authorized_keys

    7.安装过程中,发现卡在“Acquiring installation lock...”

    [root@ip-10-248-41-177 ~]# rm -rf /tmp/.scm_prepare_node.lock

    并重试

    8.发现如下错误:

    >>[19/Nov/2013 15:00:55 +0000] 1922 HTTPServer Thread-2 _cplogging ERROR [19/Nov/2013:15:00:55] ENGINE Error in HTTP server: shutting down 
    >>Traceback (most recent call last): 
    >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/CherryPy-3.2.2-py2.7.egg/cherrypy/process/servers.py", line 187, in _start_http_thread 
    >> self.httpserver.start() 
    >> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/CherryPy-3.2.2-py2.7.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1825, in start 
    >> raise socket.error(msg) 
    >>error: No socket could be created on ('NexusHadoopVM', 9000) -- [Errno 99] Cannot assign requested address 

     

    不知道为什么,AWS把HOSTNAME搞错了。所有的机器的hostname都一样:

    python -c 'import socket; print socket.getfqdn(), socket.gethostbyname(socket.getfqdn())'

    都返回:

     

    ip-10-248-41-177.us-west-2.compute.internal 10.248.41.177

    用hostname ip-172-31-23-107.us-west-2.compute.internal改正确

     

    9.在安装oozie时发现:

    Failed to create Oozie database.
    日志错误信息:
    Error: DB schema exists
    
    Stack trace for the error was (for debug purposes):
    --------------------------------------
    java.lang.Exception: DB schema exists
    	at org.apache.oozie.tools.OozieDBCLI.validateDBSchema(OozieDBCLI.java:877)
    	at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:184)
    	at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:127)
    	at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:78)

    进行如下操作后并重试,

    rm -rf /var/lib/oozie/*

  • 相关阅读:
    Fragment练习
    view有了父元素就不能再添加父元素
    margin与padding的不同
    BroadcastReceiver组件
    史上最著名的10个思想实验[转]

    godaddy域名空间购买波折
    碎片2
    程序员要多喝水
    google.com的首页换上了pc man游戏
  • 原文地址:https://www.cnblogs.com/gxc2015/p/4267891.html
Copyright © 2011-2022 走看看