zoukankan      html  css  js  c++  java
  • python 多进程代码问题以及用 pyinstaller 打包成exe 问题解决

    python 多进程运行报错concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

    #! /usr/bin/env python
    # -*- coding: utf-8 -*-#
    
    # -------------------------------------------------------------------------------
    # Name:         demo
    # Author:       yunhgu
    # Date:         2021/6/25 13:41
    # Description: 
    # -------------------------------------------------------------------------------
    from concurrent.futures import ProcessPoolExecutor, as_completed
    import time
    import multiprocessing
    import os
    
    
    def job(jobid):
        print(f"start job {jobid}   time:{time.time()}  id:{os.getpid()}")
        time.sleep(2)
        print(f"{jobid} finished")
        return "success"
    
    
    multiprocessing.freeze_support()
    with ProcessPoolExecutor(max_workers=4) as p:
        task_list = [p.submit(job, job_id) for job_id in range(5)]
        for task in as_completed(task_list):
            if task.done():
                print(task.result())
    

    image

    需要添加main

    #! /usr/bin/env python
    # -*- coding: utf-8 -*-#
    
    # -------------------------------------------------------------------------------
    # Name:         demo
    # Author:       yunhgu
    # Date:         2021/6/25 13:41
    # Description: 
    # -------------------------------------------------------------------------------
    from concurrent.futures import ProcessPoolExecutor, as_completed
    import time
    import multiprocessing
    import os
    
    
    def job(jobid):
        print(f"start job {jobid}   time:{time.time()}  id:{os.getpid()}")
        time.sleep(2)
        print(f"{jobid} finished")
        return "success"
    
    if __name__ == '__main__':
        multiprocessing.freeze_support()
        with ProcessPoolExecutor(max_workers=4) as p:
            task_list = [p.submit(job, job_id) for job_id in range(5)]
            for task in as_completed(task_list):
                if task.done():
                    print(task.result())
    

    image

    使用pyinstaller 打包成exe

    对于pyinstaller 是不支持含有多进程的python打包,打包完毕后,不会执行子进程的内容,而是会一直创建进程,导致崩溃
    解决方法:
    multiprocessing.freeze_support()
    这句话一定要放在main下的第一行,如下所示

    #! /usr/bin/env python
    # -*- coding: utf-8 -*-#
    
    # -------------------------------------------------------------------------------
    # Name:         demo
    # Author:       yunhgu
    # Date:         2021/6/25 13:41
    # Description: 
    # -------------------------------------------------------------------------------
    from concurrent.futures import ProcessPoolExecutor, as_completed
    import time
    import multiprocessing
    import os
    
    
    def job(jobid):
        print(f"start job {jobid}   time:{time.time()}  id:{os.getpid()}")
        time.sleep(2)
        print(f"{jobid} finished")
        return "success"
    
    if __name__ == '__main__':
        multiprocessing.freeze_support()
        with ProcessPoolExecutor(max_workers=4) as p:
            task_list = [p.submit(job, job_id) for job_id in range(5)]
            for task in as_completed(task_list):
                if task.done():
                    print(task.result())
    

    然后就可以正常运行了
    image

    不论你在什么时候开始,重要的是开始之后就不要停止。 不论你在什么时候结束,重要的是结束之后就不要悔恨。
  • 相关阅读:
    QTP模拟鼠标和键盘事件整理
    Linux 入门常用命令 — 改变文件或目录的访问权限
    做一个有品质的男人
    Linux下.tar .gz .tgz .bz2 .bz等解、压包命令详解
    全面整理CentOS系统使用中文
    MSDN宝藏库中,初学者应该看的东西【整理的很辛苦哦】
    IIS 7.5版本中一些诡异问题的解决方案
    老生常谈ASP.NET中的Cookies,罗列读写Cookies的方法
    分享3段平时很实用的微代码,高手莫喷
    SQL 2005中的临时表
  • 原文地址:https://www.cnblogs.com/yunhgu/p/14931682.html
Copyright © 2011-2022 走看看