zoukankan      html  css  js  c++  java
  • spark-sql jdbc操作mysql

      SparkConf sparkConf = new SparkConf()
                    .setMaster("local")
                    .setAppName("MySqlTest");
    
            JavaSparkContext javaSparkContext = new JavaSparkContext(sparkConf);
    
            SQLContext sqlContext = new SQLContext(javaSparkContext);
    
            Properties properties = new Properties();
            properties.setProperty("driver", "com.mysql.jdbc.Driver");
            properties.setProperty("user", "root");
            properties.setProperty("password", "123456");
    
    
            DataFrame df_jdbc = sqlContext.read().jdbc("jdbc:mysql://127.0.0.1:3306/bi?characterEncoding=utf8", "customer", properties);
    
            DataFrame df_jdbc_single_col = df_jdbc.select("cusCode");
            df_jdbc_single_col.show();
    
            //保存=====================
            Map<String, String> map = new HashMap<String, String>();
            map.put("driver", "com.mysql.jdbc.Driver");
            map.put("user", "root");
            map.put("password", "123456");
    
            df_jdbc_single_col.write().options(map).jdbc("jdbc:mysql://127.0.0.1:3306/bi?characterEncoding=utf8", "customer_one_col", properties);
            //=======================
  • 相关阅读:
    HQL语句中类的别名语法以及作用?
    C#面向对象
    c#异步编程一
    c#接口
    c#Socket通信基本使用
    c#FTP基本使用
    c#XML的基本使用
    c#装箱与拆箱
    c#数组与集合
    c#中for与foreach的使用
  • 原文地址:https://www.cnblogs.com/zzq-include/p/8743476.html
Copyright © 2011-2022 走看看