zoukankan      html  css  js  c++  java
  • sparkSQL脚本更改问题

    相应的pom依赖文件

    <dependencies>

    <!--
    <dependency>
    <groupId>org.apache.storm</groupId>
    <artifactId>storm-core</artifactId>
    <version>0.9.2-incubating</version>
    <scope>provided</scope>
    </dependency>
    -->

    <dependency>
    <groupId>org.scala-lang</groupId>
    <artifactId>scala-library</artifactId>
    <version>2.11.0</version>
    </dependency>

    <dependency>
    <groupId>org.scala-lang</groupId>
    <artifactId>scala-compiler</artifactId>
    <version>2.11.0</version>
    </dependency>

    <dependency>
    <groupId>org.scala-lang</groupId>
    <artifactId>scala-reflect</artifactId>
    <version>2.11.0</version>
    </dependency>

    <dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-hive_2.11</artifactId>
    <version>2.0.0</version>
    </dependency>

    <dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-core_2.11</artifactId>
    <version>2.0.0</version>
    </dependency>

    <dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-sql_2.11</artifactId>
    <version>2.0.0</version>
    </dependency>

    <dependency>
    <groupId>mchange-commons-java</groupId>
    <artifactId>mchange-commons-java</artifactId>
    <version>0.2.11</version>
    <scope>system</scope>
    <systemPath>${project.basedir}/libs/mchange-commons-java-0.2.11.jar</systemPath>
    </dependency>

    <dependency>
    <groupId>mysql-connector-java</groupId>
    <artifactId>mysql-connector-java</artifactId>
    <version>5.1.38</version>
    <scope>system</scope>
    <systemPath>${project.basedir}/libs/mysql-connector-java-5.1.38-bin.jar</systemPath>
    </dependency>

    <dependency>

    <groupId>com.microsoft.sqlserver</groupId>
    <artifactId>sqljdbc4</artifactId>
    <version>4.0</version>
    <scope>system</scope>
    <systemPath>${project.basedir}/libs/sqljdbc4-4.0.jar</systemPath>
    </dependency>

    </dependencies>
  • 相关阅读:
    周总结14
    周总结13
    周总结12
    周总结11
    周总结10
    Pytorch实现GCN、GraphSAGE、GAT
    pytorch在损失函数中为权重添加L1正则化
    conda安装虚拟环境或者软件包时一直报错
    各种报错
    Pytorch-torchtext的使用
  • 原文地址:https://www.cnblogs.com/moss-yang/p/8469696.html
Copyright © 2011-2022 走看看