zoukankan      html  css  js  c++  java
  • [大数据入门]实战练习 安装Cloudera-Hadoop集群

    实验环境规划

     

    Hostname

    IP OS Roles
    Machine 0 elephant 192.168.124.131    
    Machine 1 tiger 192.168.124.132    
    Machine 2 horse 192.168.124.133    
    Machine 3 monkey  192.168.124.134    
    Machine 4 lion 192.168.124.135    

    虚拟机软件

    vagrant
    virtualbox
    

     

    修改/etc/hosts

    192.168.124.131  elephant
    192.168.124.132 tiger
    192.168.124.133 horse
    192.168.124.134 monkey
    192.168.124.137 lion

    配置yum源

    通过下面的文档查看repo信息

    Cloudera Manager Version and Download Information

    获取包来源

    cd  /etc/yum.repos.d

    wget https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/cloudera-manager.repo

    安装 JDK

    yum install -y oracle-j2sdk*
    
    echo -e 'export JAVA_HOME=/usr/java/default' >> /etc/profile
    alternatives --install /usr/bin/java  java /usr/java/jdk1.7.0_67-cloudera/bin/java 200
    alternatives --set java /usr/java/jdk1.7.0_67-cloudera/bin/java
    alternatives --install  /usr/bin/javac javac /usr/java/jdk1.7.0_67-cloudera/bin/javac 200
    alternatives --set javac /usr/java/jdk1.7.0_67-cloudera/bin/javac
    

      

    设置数据库

    数据库的指定,

    默认的数据库,配置方法如下

        1.  确认安装数据库包

        2.  启动服务   service cloudera-scm-server-db start

    [root@elephant x86_64]# service cloudera-scm-server-db start
    The files belonging to this database system will be owned by user "cloudera-scm".
    This user must also own the server process.
    
    The database cluster will be initialized with locale en_US.UTF8.
    The default text search configuration will be set to "english".
    
    fixing permissions on existing directory /var/lib/cloudera-scm-server-db/data ... ok
    creating subdirectories ... ok
    selecting default max_connections ... 100
    selecting default shared_buffers ... 32MB
    creating configuration files ... ok
    creating template1 database in /var/lib/cloudera-scm-server-db/data/base/1 ... ok
    initializing pg_authid ... ok
    setting password ... ok
    initializing dependencies ... ok
    creating system views ... ok
    loading system objects' descriptions ... ok
    creating conversions ... ok
    creating dictionaries ... ok
    setting privileges on built-in objects ... ok
    creating information schema ... ok
    vacuuming database template1 ... ok
    copying template1 to template0 ... ok
    copying template1 to postgres ... ok
    
    Success. You can now start the database server using:
    
        postgres -D /var/lib/cloudera-scm-server-db/data
    or
        pg_ctl -D /var/lib/cloudera-scm-server-db/data -l logfile start
    
    Adding configs
    Creating SCM configuration file: /etc/cloudera-scm-server/db.properties
    waiting for server to start.... done
    server started
    CREATE ROLE
    CREATE DATABASE
    Created db properties file /etc/cloudera-scm-server/db.properties
    Creating DB amon for role ACTIVITYMONITOR
    CREATE ROLE
    CREATE DATABASE
    Created DB for role ACTIVITYMONITOR
    Creating DB rman for role REPORTSMANAGER
    CREATE ROLE
    CREATE DATABASE
    Created DB for role REPORTSMANAGER
    Creating DB nav for role NAVIGATOR
    CREATE ROLE
    CREATE DATABASE
    Created DB for role NAVIGATOR
    Creating DB navms for role NAVIGATORMETASERVER
    CREATE ROLE
    CREATE DATABASE
    Created DB for role NAVIGATORMETASERVER
    Enabled remote connections
    waiting for server to shut down.... done
    server stopped
    DB initialization done.
    waiting for server to start.... done
    server started
    

      

    使用mysql数据库,配置方法如下:

    https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.13.0/



  • 相关阅读:
    图像中的傅立叶变换(二)
    图像中的傅立叶变换(一)
    最大似然估计
    论文笔记:Batch Normalization
    TensorFlow学习笔记:共享变量
    postman管理收藏夹,批量执行接口
    postman设置token关联参数,其他接口直接读取token变量
    appium+python+unittest+HTMLRunner编写UI自动化测试集
    appium自动化环境搭建(python语言开发)
    Fiddler抓取https数据包
  • 原文地址:https://www.cnblogs.com/DBA-Ivan/p/7875437.html
Copyright © 2011-2022 走看看