zoukankan      html  css  js  c++  java
  • cdh搭建仓库

    搭建内部仓库使用yum安装cm

    Creating a Permanent Internal Repository

    1,安装httpd

     yum install httpd
     
     删除/etc/httpd/conf/httpd.conf  里的include 
     
    

    2,下载源文件cm

    Download the tarball for your OS distribution from the repo-as-tarball archive:

    Cloudera Manager 5: https://archive.cloudera.com/cm5/repo-astarball/

    CDH 5: https://archive.cloudera.com/cdh5/repo-as-tarball/

    解压

    Unpack the tarball, move the files to the web server directory, and modify filepermissions. For example, you might use the following commands

    $ tar xvfz cm5.14.0-centos7.tar.gz
    $ sudo mv cm /var/www/html
    $ sudo chmod -R ugo+rX /var/www/html/cm
    

    3,配置客户端使用repo

    Modifying Clients to Use the Internal Repository

    Create /etc/yum.repos.d/cloudera-repo.repo files on clusterhosts with the following content, where <web_server> is thehostname of the web server:

    $ [cloudera-repo]
    $ name=cloudera-repo
    $ baseurl=http://<web_server>/cm/5
    $ enabled=1
    $ gpgcheck=0
    

    4,配置parcel 仓库

    Hosting an Internal Parcel Repository

    配置httpd

    1,Download the parcel and manifest.json files for your OS distribution from:
    CDH 5: Impala, Kudu, Spark 1, and Search are included in the CDH parcel.
    CDH - https://archive.cloudera.com/cdh5/parcels/
    Accumulo - - https://archive.cloudera.com/accumulo-c5/parcels/
    GPL Extras - https://archive.cloudera.com/gplextras5/parcels/

    可以不做》

    CDS 2 Powered by Apache Spark for CDH 5:
    The exact parcel name is dependent on the OS. You can find all the parcels athttps://archive.cloudera.com/spark2/parcels/ .

    Cloudera Navigator Key Trustee Server:
    Go to the Key Trustee Server download page (http://www.cloudera.com/content/www/enus/downloads/navigator/key-trustee-server.html) . Select Parcels from the Package or Parcel drop-down menu, and click

    2,Move the .parcel and manifest.json files to the web server directory, and modify the file permissions. The hosted .sha1 files
    are not used by Cloudera Manager when it obtains the parcels from a web server. Instead, it extracts the SHA1 hashes provided in
    manifest.json . For example

    sudo mkdir -p /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
    sudo mv *.parcel* /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
    sudo mv manifest.json /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
    sudo chmod -R ugo+rX /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
    

    Replace <cdh5_version> with your CDH version (for example, 5.14.0 ). After moving the files and changing permissions, visit
    http://<web_server>/cloudera-parcels/cdh5/<cdh5_version> to verify that you can access the parcel. If you do not see
    anything, your web server may have been configured to not show indexes.

    Configuring the Cloudera Manager Server to Use the Parcel URL for Hosted Repositories

    In the Remote Parcel Repository URLs list, click the addition symbol to open an additional row.
    3. Enter the path to the parcel. For example: http://<web_server>/cdh5/<cdh5_version>
    4. Click Save Changes to commit the changes

    配置使用本地的parcel 仓库

    To use a local parcel repository, complete the following steps:

    1. Open the Cloudera Manager web UI and navigate to the Parcels page.
    2. Select Configuration and verify that you have a Local Parcel Repository path set. By default, the directory is /opt/cloudera/parcelrepo .
    3. Remove any Remote Parcel Repository URLs you are not using, including ones that point to Cloudera archives.
    4. Add the parcel you want to use to the local parcel repository directory that you specified.
    5. In the command line, navigate to the local parcel repository directory.
    6. Create a SHA1 hash for the parcel you added and save it to a file named <parcel_name>.parcel.sha .
      For example, the following command generates a SHA1 hash for the parcel CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel :
    sha1sum CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel | awk '{ print $1 }' > CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha
    
    1. Change the ownership of the parcel and hash files to cloudera-scm :

      sudo chown cloudera-scm:cloudera-scm *.parcel.*
      
    2. In the Cloudera Manager web UI, navigate to the Parcels page

    3. Click Check for New Parcels.

    4. When the new parcel appears, download, distribute, and activate the parcel

  • 相关阅读:
    [BTS] BizTalk host BizTalkServerApplication throttled because DatabaseSize exceeded the configured throttling limit.
    Linux sed 批量替换字符串方法
    MYSQL中的POSITION方法
    wc (Word Count)
    sudo
    关于数据库timestamp类型问题
    SQL中存储过程和自定义函数的区别
    数据库存储过程
    五 : springMVC拦截器
    四 : springMVC各种跳页面传值
  • 原文地址:https://www.cnblogs.com/g2thend/p/11829068.html
Copyright © 2011-2022 走看看