zoukankan      html  css  js  c++  java
  • Spark开发

    scala中的main函数

      java.lang.NoSuchMethodError: scala.tools.nsc.interpreter.ILoop.main
      在Object对象中,需要添加main函数才能够右键,run

    CacheLoader

    1 Exception in thread "main" java.lang.NoClassDefFoundError: org/spark_project/guava/cache/CacheLoader
    2 at org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:73)
    3 at org.apache.spark.SparkConf.<init>(SparkConf.scala:68)
    4 at org.apache.spark.SparkConf.<init>(SparkConf.scala:55)
    5 at org.apache.spark.SparkContext.<init>(SparkContext.scala:117)
    6 at com.spark.Main$.main(Main.scala:18)
    7 at com.spark.Main.main(Main.scala)

      添加了spark-network-common依赖,问题解决

    1 <dependency>
    2 <groupId>org.apache.spark</groupId>
    3 <artifactId>spark-network-common_2.11</artifactId>
    4 <version>2.1.0</version>
    5 </dependency>

    Scala的Array的NosuchMethod

      Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;
      scala的版本不对导致;配置文件中添加了scala的引用是2.11;intelliJ的工程师2.12。

  • 相关阅读:
    CodeForces 650C Table Compression
    HDU 5632 Rikka with Array [想法题]
    HDU 4352 XHXJ's LIS
    HDU 5634 Rikka with Phi
    HDU 4763 Theme Section
    LightOJ 1342 Aladdin and the Magical Sticks [想法题]
    HDU 4578 Transformation
    POJ 1177 Picture
    HDU 4614 Vases and Flowers
    SPOJ AEROLITE
  • 原文地址:https://www.cnblogs.com/xiashiwendao/p/8646546.html
Copyright © 2011-2022 走看看