zoukankan      html  css  js  c++  java
  • spark-sql jdbc操作mysql

      SparkConf sparkConf = new SparkConf()
                    .setMaster("local")
                    .setAppName("MySqlTest");
    
            JavaSparkContext javaSparkContext = new JavaSparkContext(sparkConf);
    
            SQLContext sqlContext = new SQLContext(javaSparkContext);
    
            Properties properties = new Properties();
            properties.setProperty("driver", "com.mysql.jdbc.Driver");
            properties.setProperty("user", "root");
            properties.setProperty("password", "123456");
    
    
            DataFrame df_jdbc = sqlContext.read().jdbc("jdbc:mysql://127.0.0.1:3306/bi?characterEncoding=utf8", "customer", properties);
    
            DataFrame df_jdbc_single_col = df_jdbc.select("cusCode");
            df_jdbc_single_col.show();
    
            //保存=====================
            Map<String, String> map = new HashMap<String, String>();
            map.put("driver", "com.mysql.jdbc.Driver");
            map.put("user", "root");
            map.put("password", "123456");
    
            df_jdbc_single_col.write().options(map).jdbc("jdbc:mysql://127.0.0.1:3306/bi?characterEncoding=utf8", "customer_one_col", properties);
            //=======================
  • 相关阅读:
    使用Eclipse的坑
    约定优于配置
    Tomcat服务器使用和debug
    spring框架排错
    spring框架学习感悟
    Spring的标签和验证等模块
    11. Container With Most Water
    1367. Linked List in Binary Tree
    486. Predict the Winner
    205. Isomorphic Strings
  • 原文地址:https://www.cnblogs.com/zzq-include/p/8743476.html
Copyright © 2011-2022 走看看