zoukankan      html  css  js  c++  java
  • hive表导出到mysql报错

    Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject

    hadoop@hadoop-virtual-machine:~/app/sqoop-1.4.6-cdh5.7.0$ bin/sqoop export --connect jdbc:mysql://localhost:3306/dbtaobao --username root --password 110110110 --table user_log --export-dir '/user/hive/warehouse/dbtaobao.db/inner_user_log' --fields-terminated-by ',';
    Warning: /home/hadoop/app/hbase does not exist! HBase imports will fail.
    Please set $HBASE_HOME to the root of your HBase installation.
    Warning: /home/hadoop/app/sqoop-1.4.6-cdh5.7.0/../hcatalog does not exist! HCatalog jobs will fail.
    Please set $HCAT_HOME to the root of your HCatalog installation.
    Warning: /home/hadoop/app/sqoop-1.4.6-cdh5.7.0/../accumulo does not exist! Accumulo imports will fail.
    Please set $ACCUMULO_HOME to the root of your Accumulo installation.
    Warning: /home/hadoop/app/sqoop-1.4.6-cdh5.7.0/../zookeeper does not exist! Accumulo imports will fail.
    Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
    18/09/13 07:35:48 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.0
    18/09/13 07:35:48 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
    18/09/13 07:35:48 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
    18/09/13 07:35:48 INFO tool.CodeGenTool: Beginning code generation
    Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
    18/09/13 07:35:49 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_log` AS t LIMIT 1
    18/09/13 07:35:49 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_log` AS t LIMIT 1
    18/09/13 07:35:49 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop/app/hadoop-2.6.0-cdh5.7.0
    注: /tmp/sqoop-hadoop/compile/93c07aefc0d6cf53115cac026f3ec442/user_log.java使用或覆盖了已过时的 API。
    注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
    18/09/13 07:35:56 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/93c07aefc0d6cf53115cac026f3ec442/user_log.jar
    18/09/13 07:35:56 INFO mapreduce.ExportJobBase: Beginning export of user_log
    Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject
    	at org.apache.sqoop.util.SqoopJsonUtil.getJsonStringforMap(SqoopJsonUtil.java:42)
    	at org.apache.sqoop.SqoopOptions.writeProperties(SqoopOptions.java:742)
    	at org.apache.sqoop.mapreduce.JobBase.putSqoopOptionsToConfiguration(JobBase.java:369)
    	at org.apache.sqoop.mapreduce.JobBase.createJob(JobBase.java:355)
    	at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:417)
    	at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
    	at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81)
    	at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
    	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
    	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
    	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
    	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
    	at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
    Caused by: java.lang.ClassNotFoundException: org.json.JSONObject
    	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    	... 14 more
    

    解决:

    这是因为sqoop缺少java-json.jar包.

    下载java-json.jar包:

    http://www.java2s.com/Code/Jar/j/Downloadjavajsonjar.htm

    把java-json.jar添加到../sqoop/lib目录

  • 相关阅读:
    Kubernetes集群管理工具kubectl命令技巧大全
    LVM 逻辑卷扩容
    制作 Ubuntu 16.04 离线apt源
    Kubernetes 存储简介
    处理K8S PVC删除后pod报错
    处理 K8S Orphaned pod found
    Kubernetes之GlusterFS集群文件系统高可用安装,提供动态卷存储
    Linux安装MYSQL并部署主从复制集群
    CentOS 7.4通过rpm包离线安装 Mysql8.0并部署主从复制(附从库备份脚本)
    容器化安装Mysql 8.0 并部署主从复制
  • 原文地址:https://www.cnblogs.com/zhangguangxiang/p/14232637.html
Copyright © 2011-2022 走看看