zoukankan      html  css  js  c++  java
  • airflow

    基于airflow官方镜像制作自己的镜像,如给镜像安装pymongo

    FROM        10.60.10.119:5000/common/air_grpc:0.0.2
    MAINTAINER  zhangchunyang@goldwind.com.cn
    
    USER 0
    RUN  pip install pymongo
    USER airflow

    镜像里都装了啥,可以通过docker history + 镜像来查看

    LocalExecutor executes tasks locally in parallel. It uses the multiprocessing Python library and queues to parallelize the execution of tasks.

    CeleryExecutor  is one of the ways you can scale out the number of workers. For this to work, you need to setup a Celery backend (RabbitMQRedis, …) and change your airflow.cfg to point the executor parameter to CeleryExecutor and provide the related Celery settings

    SequentialExecutor:This executor will only run one task instance at a time, can be used for debugging. It is also the only executor that can be used with sqlite since sqlite doesn’t support multiple connections

  • 相关阅读:
    2020.11.21日记
    Miller-Rabin质数测试
    Deepin配置记录
    shell
    module load
    vma
    DRDI
    Android.mk
    AEE
    阿里云下配置二级域名的解析设置
  • 原文地址:https://www.cnblogs.com/testzcy/p/9193012.html
Copyright © 2011-2022 走看看