zoukankan      html  css  js  c++  java

  • AWS-CDH5.5安装-软件下载

    1.下载安装介质

    下载CM安装文件:

    [root@ip-172-31-30-175 cm5.5.0]# wget -c -r -nd -np -k -L -A rpm http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:01 (369 MB/s) - ?.ndex.html?.saved [2831/2831]

Loading robots.txt; please ignore errors.
--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/robots.txt
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 404 Not Found
2015-12-01 07:55:01 ERROR 404: Not Found.

Removing index.html since it should be rejected.

--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=N;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:01 (731 MB/s) - ?.ndex.html?C=N;O=D?.saved [2831/2831]

Removing index.html?C=N;O=D since it should be rejected.

--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=M;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:02 (761 MB/s) - ?.ndex.html?C=M;O=A?.saved [2831/2831]

Removing index.html?C=M;O=A since it should be rejected.

--2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=S;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:02 (758 MB/s) - ?.ndex.html?C=S;O=A?.saved [2831/2831]

Removing index.html?C=S;O=A since it should be rejected.

--2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=D;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:02 (744 MB/s) - ?.ndex.html?C=D;O=A?.saved [2831/2831]

Removing index.html?C=D;O=A since it should be rejected.

--2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 4897544 (4.7M) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 4,897,544   3.09M/s   in 1.5s    

2015-12-01 07:55:03 (3.09 MB/s) - ?.loudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [4897544/4897544]

--2015-12-01 07:55:03--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 533925676 (509M) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 533,925,676 3.90M/s   in 1m 58s  

2015-12-01 07:57:02 (4.30 MB/s) - ?.loudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [533925676/533925676]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 8388 (8.2K) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 8,388       --.-K/s   in 0s      

2015-12-01 07:57:02 (170 MB/s) - ?.loudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [8388/8388]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 10128 (9.9K) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 10,128      --.-K/s   in 0s      

2015-12-01 07:57:02 (165 MB/s) - ?.loudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [10128/10128]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 979964 (957K) [application/x-redhat-package-manager]
Saving to: ?.nterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 979,964     4.88M/s   in 0.2s    

2015-12-01 07:57:02 (4.88 MB/s) - ?.nterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [979964/979964]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/jdk-6u31-linux-amd64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 71204325 (68M) [application/x-redhat-package-manager]
Saving to: ?.dk-6u31-linux-amd64.rpm?

100%[=====================================================================================================================================================================>] 71,204,325  4.58M/s   in 15s     

2015-12-01 07:57:18 (4.39 MB/s) - ?.dk-6u31-linux-amd64.rpm?.saved [71204325/71204325]

--2015-12-01 07:57:18--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 142039186 (135M) [application/x-redhat-package-manager]
Saving to: ?.racle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm?

100%[=====================================================================================================================================================================>] 142,039,186 4.59M/s   in 30s     

2015-12-01 07:57:48 (4.58 MB/s) - ?.racle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm?.saved [142039186/142039186]

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=N;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (834 MB/s) - ?.ndex.html?C=N;O=A?.saved [2831/2831]

Removing index.html?C=N;O=A since it should be rejected.

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=M;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (827 MB/s) - ?.ndex.html?C=M;O=D?.saved [2831/2831]

Removing index.html?C=M;O=D since it should be rejected.

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=S;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (806 MB/s) - ?.ndex.html?C=S;O=D?.saved [2831/2831]

Removing index.html?C=S;O=D since it should be rejected.

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=D;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (804 MB/s) - ?.ndex.html?C=D;O=D?.saved [2831/2831]

Removing index.html?C=D;O=D since it should be rejected.

FINISHED --2015-12-01 07:57:48--
Downloaded: 16 files, 718M in 2m 45s (4.35 MB/s)
Converted 0 files in 0 seconds.
[root@ip-172-31-30-175 cm5.5.0]#

    检查下载文件与官网大小是否一致,经常会发生在传输过程中出差，所以务必要检查您的安装文件和Cloudera官网上的大小一致:

    [root@ip-172-31-30-175 cm5.5.0]# ls -l
total 735432
-rw-r--r-- 1 root root   4897544 Nov 17 05:29 cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root 533925676 Nov 17 05:29 cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root      8388 Nov 17 05:29 cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root     10128 Nov 17 05:29 cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root    979964 Nov 17 05:29 enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root  71204325 Nov 17 05:29 jdk-6u31-linux-amd64.rpm
-rw-r--r-- 1 root root 142039186 Nov 17 05:29 oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm

    2.下载CDH parcel及manifest文件:

    [root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
    --2015-12-01 08:08:43-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
    Resolving archive-primary.cloudera.com... 54.237.90.33
    Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 1485836821 (1.4G)
    Saving to: ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?

    100%[===================================================================================================================================================================>] 1,485,836,821 5.26M/s in 4m 44s

    2015-12-01 08:13:27 (5.00 MB/s) - ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?.saved [1485836821/1485836821]

    [root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
    --2015-12-01 08:16:29-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
    Resolving archive-primary.cloudera.com... 54.237.90.33
    Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 49710 (49K) [application/json]
    Saving to: ?.anifest.json?

    100%[=====================================================================================================================================================================>] 49,710 --.-K/s in 0.1s

    2015-12-01 08:16:30 (347 KB/s) - ?.anifest.json?.saved [49710/49710]

     检查文件大小：

    [root@ip-172-31-30-175 cdh5.5.0]# ll
total 1451072
-rw-r--r-- 1 root root 1485836821 Nov 12 19:32 CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
-rw-r--r-- 1 root root      49710 Nov 12 19:32 manifest.json
[root@ip-172-31-30-175 cdh5.5.0]#

    3.下载MySQL5.6和JDBC Driver

    [root@ip-172-31-30-175 cloudera]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
--2015-12-01 08:18:13--  http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm [following]
--2015-12-01 08:18:13--  http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 55950588 (53M) [application/x-redhat-package-manager]
Saving to: ?.ySQL-server-5.6.27-1.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 55,950,588  4.98M/s   in 11s     

2015-12-01 08:18:24 (5.08 MB/s) - ?.ySQL-server-5.6.27-1.el6.x86_64.rpm?.saved [55950588/55950588]



    [root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
    --2015-12-01 08:24:01-- http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
    Resolving dev.mysql.com... 137.254.60.11
    Connecting to dev.mysql.com|137.254.60.11|:80... connected.
    HTTP request sent, awaiting response... 302 Found
    Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm [following]
    --2015-12-01 08:24:01-- http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
    Resolving cdn.mysql.com... 23.198.164.152
    Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 18596528 (18M) [application/x-redhat-package-manager]
    Saving to: ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?

    100%[=====================================================================================================================================================================>] 18,596,528 15.5M/s in 1.1s

    2015-12-01 08:24:03 (15.5 MB/s) - ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?.saved [18596528/18596528]

    [root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
--2015-12-01 08:20:50--  http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz [following]
--2015-12-01 08:20:50--  http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3928553 (3.7M) [application/x-tar-gz]
Saving to: ?.ysql-connector-java-5.1.37.tar.gz?

100%[=====================================================================================================================================================================>] 3,928,553   --.-K/s   in 0.1s    

2015-12-01 08:20:50 (29.7 MB/s) - ?.ysql-connector-java-5.1.37.tar.gz?.saved [3928553/3928553]

    检查大小:

    [root@ip-172-31-30-175 mysql]# ll
    total 76644
    -rw-r--r-- 1 root root 18596528 Sep 21 16:32 MySQL-client-5.6.27-1.el6.x86_64.rpm
    -rw-r--r-- 1 root root 3928553 Oct 6 13:24 mysql-connector-java-5.1.37.tar.gz
    -rw-r--r-- 1 root root 55950588 Sep 21 16:33 MySQL-server-5.6.27-1.el6.x86_64.rpm

     注意：这里还需要下载两个文件：MySQL-devel-5.6.27-1.el6.x86_64.rpm  MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm，最后的文件目录应该如下:

    [root@ip-172-31-30-175 mysql]# ls 
MySQL-client-5.6.27-1.el6.x86_64.rpm  mysql-connector-java-5.1.37.zip      MySQL-server-5.6.27-1.el6.x86_64.rpm
mysql-connector-java-5.1.37           MySQL-devel-5.6.27-1.el6.x86_64.rpm  MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm
  • 相关阅读:
    1026 Table Tennis (30)
    1029 Median
    1025 PAT Ranking (25)
    1017 Queueing at Bank (25)
    1014 Waiting in Line (30)
    1057 Stack (30)
    1010 Radix (25)
    1008 Elevator (20)
    字母大小写转换
    Nmap的基础知识
  • 原文地址：https://www.cnblogs.com/littlesuccess/p/5010474.html
Copyright © 2011-2022 走看看