zoukankan      html  css  js  c++  java
  • Sqoop 1.4.6 安装配置

    • 配置环境变量
    # SQOOP
    SQOOP_HOME=/home/hadoop/development/src/sqoop-1.4.6-cdh5.6.0
    PATH=$PATH:$SQOOP_HOME/bin
    export PATH

    cd 到Sqoop根目录

    配置Sqoop核心文件

    主要配置${SQOOP_HOME}/conf/sqoop-env-template.sh 文件

    cp ${SQOOP_HOME}/conf/sqoop-env-template.sh ${SQOOP_HOME}/conf/sqoop-env.sh

    主要修改参数

    # 指定 Hadoop 安装目录
    export HADOOP_COMMON_HOME=
    # 指定 Hadoop MapReduce 技术jar存放目录
    export HADOOP_MAPRED_HOME=
    # Hbase 安装目录
    export HBASE_HOME=
    # Zookeeper 安装目录
    export ZOOCFGDIR=

    如果没有安装的可以不用填写

    例如

    #Set path to where bin/hadoop is available
    export HADOOP_COMMON_HOME=/home/hadoop/development/src/hadoop-2.6.0-cdh5.6.0
    
    #Set path to where hadoop-*-core.jar is available
    "这里之所以和Hadoop安装目录一样,是由于上次我配置成mapreduce jar地址时,sqoop报错"
    export HADOOP_MAPRED_HOME=/home/hadoop/development/src/hadoop-2.6.0-cdh5.6.0
    
    #set the path to where bin/hbase is available
    "我没有安装Hbase所以这里直接 注释掉就可以"
    #export HBASE_HOME=
    
    #Set the path to where bin/hive is available
    export HIVE_HOME=/home/hadoop/development/src/hive-1.1.0-cdh5.6.0
    
    #Set the path for where zookeper config dir is
    export ZOOCFGDIR=/home/hadoop/development/src/zookeeper-3.4.5-cdh5.6.0

    测试Sqoop是否配置成功

    sqoop list-databases --connect jdbc:mysql://192.168.2.251:3306/canbot --username root --password root
    
    
    Warning: /home/hadoop/development/src/sqoop-1.4.6-cdh5.6.0/bin/../../hbase does not exist! HBase imports will fail.
    Please set $HBASE_HOME to the root of your HBase installation.
    Warning: /home/hadoop/development/src/sqoop-1.4.6-cdh5.6.0/bin/../../hcatalog does not exist! HCatalog jobs will fail.
    Please set $HCAT_HOME to the root of your HCatalog installation.
    Warning: /home/hadoop/development/src/sqoop-1.4.6-cdh5.6.0/bin/../../accumulo does not exist! Accumulo imports will fail.
    Please set $ACCUMULO_HOME to the root of your Accumulo installation.
    Warning: /home/hadoop/development/src/sqoop-1.4.6-cdh5.6.0/bin/../../zookeeper does not exist! Accumulo imports will fail.
    Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
    16/05/23 10:34:46 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.6.0
    16/05/23 10:34:46 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
    16/05/23 10:34:47 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
    "information_schema
    canbot
    from_66internet
    from_fhmysql
    hive
    mysql
    sys_app_user"
  • 相关阅读:
    tensorflow1.0 矩阵相乘
    tensorflow1.0 变量加法
    python 给字典按值排序,同样适合于其他
    pytorch 孪生神经网络DNN
    python 利用numpy同时打乱列表的顺序,同时打乱数据和标签的顺序
    python os模块获取指定目录下的文件列表
    创建自定义ssl证书用于https
    使用Maven命令行下载依赖库
    JAVA入门各种API参考
    在centos 6.9 x64下安装code::blocks步骤
  • 原文地址:https://www.cnblogs.com/likui360/p/7127037.html
Copyright © 2011-2022 走看看