zoukankan      html  css  js  c++  java
  • 在spark-shell里用集群方式启动时加入用户需要的jar

    希望在spark-shell中测试集群方式的elasticsearch操作,

    # 1 首先下载相关的jar

    # 2 启动spark-shell时用--jars 

    ./bin/spark-shell –master spark://master:7077 –jars /usr/local/spark-1.6.2/lib/elasticsearch-spark_2.10-2.2.0.jar

    # 3 需要用conf设置es.nodes

    val conf = new SparkConf()
    conf.set("es.index.auto.create", "true")
    conf.set("es.nodes", "192.168.1.102,192.168.1.103,192.168.1.104")

  • 相关阅读:
    python10.31
    python10.29
    python10.28
    python10.27
    python10.25
    python10.24
    python10.23
    四边形不等式与决策单调
    0x57~0x59
    0x55~0x56
  • 原文地址:https://www.cnblogs.com/mayidudu/p/5764122.html
Copyright © 2011-2022 走看看