zoukankan      html  css  js  c++  java
  • cdh版本的sqoop安装以及配置

    sqoop安装需要提前安装好sqoop依赖:hadoop 、hive、hbase、zookeeper

    hadoop安装步骤请访问:http://www.cnblogs.com/xningge/articles/8433297.html

    hive安装步骤请访问:http://www.cnblogs.com/xningge/p/8433792.html

    hbase安装步骤请访问:

    zookeeper安装步骤请访问:http://www.cnblogs.com/xningge/p/8433618.html

    sqoop需要的软件包:sqoop-1.4.5-cdh5.3.6.tar.gz

    1、上传sqoop软件包到Linux系统指定目录:/opt/softwares/cdh

    2、解压 sqoop软件包到指定目录:/opt/modules/cdh/

      tar -zxvf sqoop-1.4.5-cdh5.3.6.tar.gz -C /opt/modules/cdh/

    3 、配置conf/sqoop-env.sh

      复制:$ cp -a sqoop-env-template.sh sqoop-env.sh或直接重命名

      

    #Set path to where bin/hadoop is available
    export HADOOP_COMMON_HOME=/opt/modules/cdh/hadoop-2.5.0-cdh5.3.6

    #Set path to where hadoop-*-core.jar is available
    export HADOOP_MAPRED_HOME=/opt/modules/cdh/hadoop-2.5.0-cdh5.3.6

    #set the path to where bin/hbase is available
    export HBASE_HOME=/opt/modules/cdh/hbase-0.98.6-cdh5.3.6

    #Set the path to where bin/hive is available
    export HIVE_HOME=/opt/modules/cdh/hive-0.13.1-cdh5.3.6

    #Set the path for where zookeper config dir is
    export ZOOCFGDIR=/opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6

    4、拷贝jdbc驱动包达到lib目录

      $ cp /opt/modules/apache-hive-0.13.1-bin/lib/mysql-connector-java-5.1.27-bin.jar  /opt/modules/cdh/sqoop-1.4.5-cdh5.3.6/lib/

    5、测试

      查看帮助信息:bin/sqoop help
      测试:sqoop 连接 mysql
      bin/sqoop list-databases --help
      bin/sqoop list-databases --connect jdbc:mysql://hadoop01.xningge.com:3306/ --username root --password ???

     

  • 相关阅读:
    CF终于上紫了。。。
    CF567F/51nod2522 上下序列
    bzoj 前100题计划
    CF1110G Tree-Tac-Toe 博弈论、构造
    BZOJ4816 SDOI2017 数字表格 莫比乌斯反演
    UOJ400/LOJ2553 CTSC2018 暴力写挂 边分治、虚树
    Luogu4774 NOI2018 屠龙勇士 ExCRT
    CF1039D You Are Given a Tree 根号分治、二分、贪心
    CF1056E Check Transcription 字符串哈希
    Luogu4345 SHOI2015 超能粒子炮·改 Lucas、数位DP
  • 原文地址:https://www.cnblogs.com/xningge/p/8433860.html
Copyright © 2011-2022 走看看