zoukankan      html  css  js  c++  java
  • Python使用signal定时结束AsyncIOScheduler任务

    在使用aiohttp结合apscheduler的AsyncIOScheduler模拟定点并发的时候遇到两个问题

    1. 在调度器scheduler.start()后,程序直接退出(在Jupiter中任务可以正常启动)
    2. 如何在指定时间调用scheduler.shutdown()? (因为程序直接退出了)
      原调试代码如下:
    from datetime import datetime, timedelta
    
    import aiohttp
    from apscheduler.schedulers.asyncio import AsyncIOScheduler
    from apscheduler.jobstores.sqlalchemy import SQLAlchemyJobStore
    
    
    async def get(session):
        url = 'https://httpbin.org/get?a=1'
        async with session.get(url) as res:
            print('get', res.status)
            return await res.text()
    
    
    async def post(session):
        url = 'https://httpbin.org/post?b=2'
        async with session.post(url) as res:
            print('post', res.status)
            return await res.text()
    
    
    async def main():
        async with aiohttp.ClientSession() as session:
            await get(session)
            await post(session)
    
    
    if __name__ == '__main__':
        jobstores = {'default': SQLAlchemyJobStore(url='sqlite:///jobs.sqlite')}
        scheduler = AsyncIOScheduler(jobstores=jobstores)
        for i in range(10):  # 添加10个任务
            job = scheduler.add_job(main, 'date', run_date=datetime.now() + timedelta(seconds=10))
        scheduler.start()
    

    Google后发现AsyncIOScheduler的使用需要在scheduler启动后,需要自己调用asyncio.get_event_loop().run_forever()来启动协程任务。
    但是一旦run_forever()则就会阻塞至死。除非有KeyboardInterrupt, SystemExit等异常或者强杀来停止其运行。
    此时想到使用Python的signal来定时发送信号,修改后程序如下,可以正常延迟停止(感觉有点像模拟Go的defer)。

    # -*- coding: utf-8 -*-
    """
    @Time : 2021/7/23
    @Auth : hanzhichao
    @Desc:
    """
    from datetime import datetime, timedelta
    import signal
    import asyncio
    
    import aiohttp
    from apscheduler.schedulers.asyncio import AsyncIOScheduler
    from apscheduler.jobstores.sqlalchemy import SQLAlchemyJobStore
    
    
    async def get(session):
        url = 'https://httpbin.org/get?a=1'
        async with session.get(url) as res:
            print('get', res.status)
            return await res.text()
    
    
    async def post(session):
        url = 'https://httpbin.org/post?b=2'
        async with session.post(url) as res:
            print('post', res.status)
            return await res.text()
    
    
    async def main():
        async with aiohttp.ClientSession() as session:
            await get(session)
            await post(session)
    
    
    if __name__ == '__main__':
        jobstores = {'default': SQLAlchemyJobStore(url='sqlite:///jobs.sqlite')}
        scheduler = AsyncIOScheduler(jobstores=jobstores)
        for i in range(10):  # 添加10个任务
            job = scheduler.add_job(main, 'date', run_date=datetime.now() + timedelta(seconds=10))
        scheduler.start()
        signal.alarm(20)  # 20秒后终止程序
        asyncio.get_event_loop().run_forever()  # 永远运行
    
  • 相关阅读:
    hdu6199 gems gems gems dp+博弈
    codeforces 429 On the Bench dp+排列组合 限制相邻元素,求合法序列数。
    hdu6153 扩展kmp求一个字符串的后缀在另一个字符串出现的次数。
    hdu6149 Valley Numer II 分组背包+状态压缩
    hdu6125 Free from square 分组背包+状态压缩
    hdu1712 ACboy needs your help 分组背包
    hdu6121 Build a tree 模拟
    hdu6134 Battlestation Operational 莫比乌斯第一种形式
    hdu6143 Killer Names 容斥+排列组合
    将Long类型转为字母数字组合的jar包---Hashids
  • 原文地址:https://www.cnblogs.com/superhin/p/15060818.html
Copyright © 2011-2022 走看看