zoukankan      html  css  js  c++  java
  • airflow

    基于airflow官方镜像制作自己的镜像,如给镜像安装pymongo

    FROM        10.60.10.119:5000/common/air_grpc:0.0.2
    MAINTAINER  zhangchunyang@goldwind.com.cn
    
    USER 0
    RUN  pip install pymongo
    USER airflow

    镜像里都装了啥,可以通过docker history + 镜像来查看

    LocalExecutor executes tasks locally in parallel. It uses the multiprocessing Python library and queues to parallelize the execution of tasks.

    CeleryExecutor  is one of the ways you can scale out the number of workers. For this to work, you need to setup a Celery backend (RabbitMQRedis, …) and change your airflow.cfg to point the executor parameter to CeleryExecutor and provide the related Celery settings

    SequentialExecutor:This executor will only run one task instance at a time, can be used for debugging. It is also the only executor that can be used with sqlite since sqlite doesn’t support multiple connections

  • 相关阅读:
    AssetBundleNote
    UNet笔记
    HololensAR开发设置
    Hololens真机使用Unity开发流程
    数据结构笔记
    解决粘包问题
    使用C#中的Socket进行通讯
    解决Sql注入,防止恶意数据
    110. 平衡二叉树
    104.二叉树的最大深度
  • 原文地址:https://www.cnblogs.com/testzcy/p/9193012.html
Copyright © 2011-2022 走看看