zoukankan      html  css  js  c++  java
  • Flink学习笔记——Environment

    Flink有以下几种Environment

    1. 批处理Environment,ExecutionEnvironment

    ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
    

    2.流处理Environment,StreamExecutionEnvironment

    StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
    

    3. 本机Environment,LocalEnvironment

    ExecutionEnvironment env = LocalEnvironment.getExecutionEnvironment();
    

    4. java集合Environment,CollectionEnvironment

    ExecutionEnvironment env = CollectionEnvironment.getExecutionEnvironment();
    

    Ref

    https://www.yuque.com/cuteximi/base/flink-02?language=en-us
    

      

    创建Environment的方法

    1. getExecutionEnvironment ,含义就是本地运行就是 createLocalEnvironment,如果是通过client提交到集群上,就返回集群的环境

     Creates an execution environment that represents the context in which the program is currently executed.
    	 * If the program is invoked standalone, this method returns a local execution environment, as returned by
    	 * {@link #createLocalEnvironment()}. If the program is invoked from within the command line client to be
    	 * submitted to a cluster, this method returns the execution environment of this cluster.
    

    Ref

    https://github.com/apache/flink/blob/master/flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java
    

    2. createLocalEnvironment ,返回本地执行环境,需要在调用时指定默认的并行度,比如

    LocalStreamEnvironment env1 = StreamExecutionEnvironment.createLocalEnvironment(1);
    
    LocalEnvironment env2 = ExecutionEnvironment.createLocalEnvironment(1);
    

    3. createRemoteEnvironment, 返回集群执行环境,将 Jar 提交到远程服务器。需要在调用时指定 JobManager 的 IP 和端口号,并指定要在集群中运行的 Jar 包,比如

    StreamExecutionEnvironment env1 = StreamExecutionEnvironment.createRemoteEnvironment("127.0.0.1", 8080, "/path/word_count.jar");
    
    ExecutionEnvironment env2 = ExecutionEnvironment.createRemoteEnvironment("127.0.0.1", 8080, "/path/word_count.jar");
    

      

  • 相关阅读:
    nginx rewrite 模块
    nginx 的请求处理流程
    nginx keepalive 长连接
    cglib、orika、spring等bean copy工具性能测试和原理分析
    jackson、fastjson、kryo、protostuff等序列化工具性能对比
    Java源码详解系列(十一)--Spring的使用和源码(共计4篇博客)
    Spring源码系列(四)--spring-aop是如何设计的
    Spring源码系列(三)--spring-aop的基础组件、架构和使用
    JMH--一款由OpenJDK开发的基准测试工具
    MySQL系列文章汇总
  • 原文地址:https://www.cnblogs.com/tonglin0325/p/14116392.html
Copyright © 2011-2022 走看看