zoukankan      html  css  js  c++  java
  • spark源码阅读

    根据spark2.2的编译顺序来确定源码阅读顺序,只阅读核心的基本部分。

    1、common目录

    ①Tags
    ②Sketch
    ③Networking
    ④Shuffle Streaming Service
    ⑤Unsafe

    2、launcher目录

    3、core目录

     spark的编译顺序是:

    [INFO] Reactor Build Order:
    [INFO]
    [INFO] Spark Project Parent POM
    [INFO] Spark Project Tags
    [INFO] Spark Project Sketch
    [INFO] Spark Project Networking
    [INFO] Spark Project Shuffle Streaming Service
    [INFO] Spark Project Unsafe
    [INFO] Spark Project Launcher
    [INFO] Spark Project Core
    [INFO] Spark Project ML Local Library
    [INFO] Spark Project GraphX
    [INFO] Spark Project Streaming
    [INFO] Spark Project Catalyst
    [INFO] Spark Project SQL
    [INFO] Spark Project ML Library
    [INFO] Spark Project Tools
    [INFO] Spark Project Hive
    [INFO] Spark Project REPL
    [INFO] Spark Project Assembly
    [INFO] Spark Project External Flume Sink
    [INFO] Spark Project External Flume
    [INFO] Spark Project External Flume Assembly
    [INFO] Spark Integration for Kafka 0.8
    [INFO] Kafka 0.10 Source for Structured Streaming
    [INFO] Spark Project Examples
    [INFO] Spark Project External Kafka Assembly
    [INFO] Spark Integration for Kafka 0.10
    [INFO] Spark Integration for Kafka 0.10 Assembly

  • 相关阅读:
    php1
    c# out参数
    c#冒泡算法
    c#方法 最大值我最小值
    方法
    OUT参数
    芮年
    PHP博客
    数组习题
    从郑和下西洋 到华人爱燕窝
  • 原文地址:https://www.cnblogs.com/cenglinjinran/p/8468716.html
Copyright © 2011-2022 走看看