zoukankan      html  css  js  c++  java
  • [hadoop读书笔记] 第十五章 sqoop1.4.6小实验

    导入命令

    sqoop import 
    --connect jdbc:mysql://192.168.200.250:3306/sqoop 
    --table widgets 
    --hbase-create-table
    --hbase-table WIDGETS_IN_HBASE 
    --column-family product 
    --hbase-row-key id 
    --username 'root' 
    -P

    说明:
    --connect jdbc:mysql://192.168.200.250:3306/sqoop 表示远程或者本地 Mysql 服务的URI,3306是Mysql默认监听端口, sqoop 是数据库,若是其他数据库,如Oracle,只需修改URI即可。
    --table widgets 表示导出 sqoop 数据库的 widgets 表。
    --hbase-table WIDGETS_IN_HBASE 表示在HBase中建立表 WIDGETS_IN_HBASE 。
    --column-family product 表示在表A中建立列族 product 。
    --hbase-row-key id 表示表 WIDGETS_IN_HBASE 的row-key是 widgets 表的id字段。
    --hbase-create-table 表示在HBase中建立表。
    --username 'root' 表示使用用户root连接Mysql。

    sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-create-table --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --username 'root' -P

    报错:

    如上可知,找不到HBASE的classpath,加载不到JAR,因此将$HBASE_HOME 设置到环境变量中:

    再次执行sqoop导入

    据说是兼容性问题,手动创建该表

    再次执行,成功!

    后台日志:

    [hadoop@hadoop-allinone-200-123 bin]$  
    sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --hbase-create-table --username 'root' -P17/01/24 01:55:47 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6 Enter password: 17/01/24 01:56:04 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 17/01/24 01:56:04 INFO tool.CodeGenTool: Beginning code generation 17/01/24 01:56:04 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1 17/01/24 01:56:04 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1 17/01/24 01:56:04 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /wdcloud/app/hadoop-2.7.3 Note: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 17/01/24 01:56:08 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.jar 17/01/24 01:56:08 WARN manager.MySQLManager: It looks like you are importing from mysql. 17/01/24 01:56:08 WARN manager.MySQLManager: This transfer can be faster! Use the --direct 17/01/24 01:56:08 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path. 17/01/24 01:56:08 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql) 17/01/24 01:56:08 INFO mapreduce.ImportJobBase: Beginning import of widgets 17/01/24 01:56:08 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/wdcloud/app/hbase-1.1.6/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 17/01/24 01:56:09 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar 17/01/24 01:56:09 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 17/01/24 01:56:10 INFO zookeeper.RecoverableZooKeeper:
    Process identifier=hconnection-0x333d2dad connecting to ZooKeeper ensemble=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop-allinone-200-123.wdcloud.locl 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_67 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.home=/wdcloud/app/jdk1u7/jre 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/wdcloud/app/hadoop-2.7.3/etc/hadoop:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/wdcloud/app/sqoop-1.4.6/conf::/wdcloud/app/sqoop-1.4.6/lib/ant-contrib-1.0b3.jar:/wdcloud/app/sqoop-1.4.6/lib/ant-eclipse-1.0-jvm1.2.jar:/wdcloud/app/sqoop-1.4.6/lib/avro-1.7.5.jar:/wdcloud/app/sqoop-1.4.6/lib/avro-mapred-1.7.5-hadoop2.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-codec-1.4.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-compress-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-io-1.4.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-jexl-2.1.1.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-logging-1.1.1.jar:/wdcloud/app/sqoop-1.4.6/lib/hsqldb-1.8.0.10.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-annotations-2.3.0.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-core-2.3.1.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-databind-2.3.1.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-data-core-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-data-hive-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-data-mapreduce-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-hadoop-compatibility-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/mysql-connector-java-5.1.40-bin.jar:/wdcloud/app/sqoop-1.4.6/lib/opencsv-2.3.jar:/wdcloud/app/sqoop-1.4.6/lib/paranamer-2.3.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-avro-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-column-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-common-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-encoding-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-format-2.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-generator-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-hadoop-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-jackson-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/slf4j-api-1.6.1.jar:/wdcloud/app/sqoop-1.4.6/lib/snappy-java-1.0.5.jar:/wdcloud/app/sqoop-1.4.6/lib/xz-1.0.jar:/wdcloud/app/hbase-1.1.6/conf:/wdcloud/app/jdk1u7/lib/tools.jar:/wdcloud/app/hbase-1.1.6:/wdcloud/app/hbase-1.1.6/lib/activation-1.1.jar:/wdcloud/app/hbase-1.1.6/lib/aopalliance-1.0.jar:/wdcloud/app/hbase-1.1.6/lib/apacheds-i18n-2.0.0-M15.jar:/wdcloud/app/hbase-1.1.6/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/wdcloud/app/hbase-1.1.6/lib/api-asn1-api-1.0.0-M20.jar:/wdcloud/app/hbase-1.1.6/lib/api-util-1.0.0-M20.jar:/wdcloud/app/hbase-1.1.6/lib/asm-3.1.jar:/wdcloud/app/hbase-1.1.6/lib/avro-1.7.4.jar:/wdcloud/app/hbase-1.1.6/lib/commons-beanutils-1.7.0.jar:/wdcloud/app/hbase-1.1.6/lib/commons-beanutils-core-1.8.0.jar:/wdcloud/app/hbase-1.1.6/lib/commons-cli-1.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-codec-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/commons-collections-3.2.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-compress-1.4.1.jar:/wdcloud/app/hbase-1.1.6/lib/commons-configuration-1.6.jar:/wdcloud/app/hbase-1.1.6/lib/commons-daemon-1.0.13.jar:/wdcloud/app/hbase-1.1.6/lib/commons-digester-1.8.jar:/wdcloud/app/hbase-1.1.6/lib/commons-el-1.0.jar:/wdcloud/app/hbase-1.1.6/lib/commons-httpclient-3.1.jar:/wdcloud/app/hbase-1.1.6/lib/commons-io-2.4.jar:/wdcloud/app/hbase-1.1.6/lib/commons-lang-2.6.jar:/wdcloud/app/hbase-1.1.6/lib/commons-logging-1.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-math-2.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-math3-3.1.1.jar:/wdcloud/app/hbase-1.1.6/lib/commons-net-3.1.jar:/wdcloud/app/hbase-1.1.6/lib/disruptor-3.3.0.jar:/wdcloud/app/hbase-1.1.6/lib/findbugs-annotations-1.3.9-1.jar:/wdcloud/app/hbase-1.1.6/lib/guava-12.0.1.jar:/wdcloud/app/hbase-1.1.6/lib/guice-3.0.jar:/wdcloud/app/hbase-1.1.6/lib/guice-servlet-3.0.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-annotations-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-auth-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-client-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-hdfs-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-app-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-core-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-api-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-client-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-server-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-annotations-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-annotations-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-client-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-common-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-common-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-examples-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-hadoop2-compat-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-hadoop-compat-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-it-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-it-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-prefix-tree-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-procedure-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-protocol-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-resource-bundle-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-rest-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-server-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-server-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-shell-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-thrift-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hbase-1.1.6/lib/httpclient-4.2.5.jar:/wdcloud/app/hbase-1.1.6/lib/httpcore-4.1.3.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jamon-runtime-2.3.1.jar:/wdcloud/app/hbase-1.1.6/lib/jasper-compiler-5.5.23.jar:/wdcloud/app/hbase-1.1.6/lib/jasper-runtime-5.5.23.jar:/wdcloud/app/hbase-1.1.6/lib/javax.inject-1.jar:/wdcloud/app/hbase-1.1.6/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hbase-1.1.6/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hbase-1.1.6/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hbase-1.1.6/lib/jcodings-1.0.8.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-client-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-core-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-guice-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-json-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-server-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jets3t-0.9.0.jar:/wdcloud/app/hbase-1.1.6/lib/jettison-1.3.3.jar:/wdcloud/app/hbase-1.1.6/lib/jetty-6.1.26.jar:/wdcloud/app/hbase-1.1.6/lib/jetty-sslengine-6.1.26.jar:/wdcloud/app/hbase-1.1.6/lib/jetty-util-6.1.26.jar:/wdcloud/app/hbase-1.1.6/lib/joni-2.1.2.jar:/wdcloud/app/hbase-1.1.6/lib/jruby-complete-1.6.8.jar:/wdcloud/app/hbase-1.1.6/lib/jsch-0.1.42.jar:/wdcloud/app/hbase-1.1.6/lib/jsp-2.1-6.1.14.jar:/wdcloud/app/hbase-1.1.6/lib/jsp-api-2.1-6.1.14.jar:/wdcloud/app/hbase-1.1.6/lib/junit-4.12.jar:/wdcloud/app/hbase-1.1.6/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hbase-1.1.6/lib/libthrift-0.9.0.jar:/wdcloud/app/hbase-1.1.6/lib/log4j-1.2.17.jar:/wdcloud/app/hbase-1.1.6/lib/metrics-core-2.2.0.jar:/wdcloud/app/hbase-1.1.6/lib/netty-3.2.4.Final.jar:/wdcloud/app/hbase-1.1.6/lib/netty-all-4.0.23.Final.jar:/wdcloud/app/hbase-1.1.6/lib/paranamer-2.3.jar:/wdcloud/app/hbase-1.1.6/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hbase-1.1.6/lib/servlet-api-2.5-6.1.14.jar:/wdcloud/app/hbase-1.1.6/lib/servlet-api-2.5.jar:/wdcloud/app/hbase-1.1.6/lib/slf4j-api-1.7.7.jar:/wdcloud/app/hbase-1.1.6/lib/slf4j-log4j12-1.7.5.jar:/wdcloud/app/hbase-1.1.6/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hbase-1.1.6/lib/spymemcached-2.11.6.jar:/wdcloud/app/hbase-1.1.6/lib/xmlenc-0.52.jar:/wdcloud/app/hbase-1.1.6/lib/xz-1.0.jar:/wdcloud/app/hbase-1.1.6/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/etc/hadoop:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar:/wdcloud/app/sqoop-1.4.6/sqoop-1.4.6.jar:/wdcloud/app/sqoop-1.4.6/sqoop-test-1.4.6.jar::/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/wdcloud/app/hadoop-2.7.3/lib/native 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-229.el7.x86_64 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.dir=/wdcloud/app/sqoop-1.4.6/bin 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 sessionTimeout=90000 watcher=hconnection-0x333d2dad0x0, quorum=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183, baseZNode=/hbase 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181. Will not attempt to authenticate using SASL (unknown error) 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Socket connection established to hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, initiating session 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, sessionid = 0x159cecea3b60004, negotiated timeout = 40000 17/01/24 01:56:12 INFO mapreduce.HBaseImportJob: Creating missing column family product 17/01/24 01:56:12 INFO client.HBaseAdmin: Started disable of WIDGETS_IN_HBASE 17/01/24 01:56:15 INFO client.HBaseAdmin: Disabled WIDGETS_IN_HBASE 17/01/24 01:56:16 INFO client.HBaseAdmin: Started enable of WIDGETS_IN_HBASE 17/01/24 01:56:17 INFO client.HBaseAdmin: Enabled WIDGETS_IN_HBASE 17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService 17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x159cecea3b60004 17/01/24 01:56:17 INFO zookeeper.ZooKeeper: Session: 0x159cecea3b60004 closed 17/01/24 01:56:17 INFO zookeeper.ClientCnxn: EventThread shut down 17/01/24 01:56:17 INFO client.RMProxy: Connecting to ResourceManager at hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:8032 17/01/24 01:56:24 INFO db.DBInputFormat: Using read commited transaction isolation 17/01/24 01:56:24 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`id`), MAX(`id`) FROM `widgets` 17/01/24 01:56:24 INFO mapreduce.JobSubmitter: number of splits:4 17/01/24 01:56:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485230213604_0007 17/01/24 01:56:26 INFO impl.YarnClientImpl: Submitted application application_1485230213604_0007 17/01/24 01:56:26 INFO mapreduce.Job: The url to track the job: http://hadoop-allinone-200-123.wdcloud.locl:8088/proxy/application_1485230213604_0007/ 17/01/24 01:56:26 INFO mapreduce.Job: Running job: job_1485230213604_0007 17/01/24 01:56:42 INFO mapreduce.Job: Job job_1485230213604_0007 running in uber mode : false 17/01/24 01:56:42 INFO mapreduce.Job: map 0% reduce 0% 17/01/24 01:57:00 INFO mapreduce.Job: map 25% reduce 0% 17/01/24 01:57:01 INFO mapreduce.Job: map 75% reduce 0% 17/01/24 01:57:02 INFO mapreduce.Job: map 100% reduce 0% 17/01/24 01:57:03 INFO mapreduce.Job: Job job_1485230213604_0007 completed successfully 17/01/24 01:57:03 INFO mapreduce.Job: Counters: 31 File System Counters FILE: Number of bytes read=0 FILE: Number of bytes written=672888 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=393 HDFS: Number of bytes written=0 HDFS: Number of read operations=4 HDFS: Number of large read operations=0 HDFS: Number of write operations=0 Job Counters Killed map tasks=1 Launched map tasks=4 Other local map tasks=4 Total time spent by all maps in occupied slots (ms)=59561 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=59561 Total vcore-milliseconds taken by all map tasks=59561 Total megabyte-milliseconds taken by all map tasks=60990464 Map-Reduce Framework Map input records=4 Map output records=4 Input split bytes=393 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=1163 CPU time spent (ms)=17450 Physical memory (bytes) snapshot=1051938816 Virtual memory (bytes) snapshot=11712344064 Total committed heap usage (bytes)=882900992 File Input Format Counters Bytes Read=0 File Output Format Counters Bytes Written=0 17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 46.0288 seconds (0 bytes/sec) 17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Retrieved 4 records.

    查看作业历史执行情况

    查看hbase表 WIDGETS_IN_HBASE 数据

    追加数据,与导入hdfs不同,无需使用--append 参数,再次运行导入命令即可重新导入新数据

  • 相关阅读:
    OK335x mksd.sh hacking
    Qt jsoncpp 对象拷贝、删除、函数调用 demo
    OK335xS 256M 512M nand flash make ubifs hacking
    Qt QScrollArea and layout in code
    JsonCpp Documentation
    Qt 4.8.5 jsoncpp lib
    Oracle数据库生成UUID
    freemarker得到数组的长度
    FreeMarker中if标签内的判断条件
    freemarker语法
  • 原文地址:https://www.cnblogs.com/avivaye/p/6347180.html
Copyright © 2011-2022 走看看