supervisord进程管理工具小结

前言

    昨天临近下班，发现业务队列处理不及时，正好想到不久之前，上了一个新功能：通过队列异步转发微信消息。可能是消息太多了处理不过来，没怎么多想，处理不过来了，多增加处理进程就可以了，后来发现自己so young了 >_<！启动处理进程，必须先安装进程管理工具，比较出名的有supervisord，使用python语言实现。折腾了近半小时，后来发现自己不可能在短时间内搞定这个事情，业务上用户消息没有得到及时回复，需要快速处理，最后还是寻求公司大神帮助安装其它前端机的supervisord。为了学会安装以及使用这个神器，为了以后碰到这样的问题可以自己搞定，在测试机上尝试安装了这个神器，于是有了这篇总结的文章。

查看依赖python模块是否安装(只安装没有的依赖包)

[root@mtest3 ~]# python -u -c "help('modules')" > a.log
[root@mtest3 ~]# cat a.log | grep element
[root@mtest3 ~]# cat a.log | grep meld
[root@mtest3 ~]# cat a.log | grep setuptool

先安装依赖包
1.elementtree-1.2.6-20050316.tar.gz

[root@mtest3 Supervisord]# tar -xvf elementtree-1.2.6-20050316.tar.gz 
[root@mtest3 Supervisord]# cd elementtree-1.2.6-20050316
[root@mtest3 elementtree-1.2.6-20050316]# python setup.py install

2.meld3-0.6.5.tar.gz

[root@mtest3 Supervisord]# tar -xvf meld3-0.6.5.tar.gz 
[root@mtest3 Supervisord]# cd meld3-0.6.5
[root@mtest3 meld3-0.6.5]# python setup.py install

3.setuptools-20.2.2.tar.gz

[root@mtest3 Supervisord]# tar -xvf setuptools-20.2.2.tar.gz
[root@mtest3 Supervisord]# cd setuptools-20.2.2
[root@mtest3 setuptools-20.2.2]# python setup.py install

3.安装supervisord

[root@mtest3 Supervisord]# tar -xvf supervisor-3.2.2.tar.gz 
[root@mtest3 Supervisord]# cd supervisor-3.2.2
[root@mtest3 supervisor-3.2.2]# python setup.py install

Installing echo_supervisord_conf script to /usr/bin
Installing pidproxy script to /usr/bin
Installing supervisorctl script to /usr/bin
Installing supervisord script to /usr/bin

生成配置文件

 [root@mtest3 ~]# echo_supervisord_conf > /u01/server/supervisord/conf/supervisord.conf 

设置

; Sample supervisor config file.
;
; For more information on the config file, please see:
; http://supervisord.org/configuration.html
;

[unix_http_server]
file=/u01/server/supervisord/temp/supervisor.sock ; (the path to the socket file)

[supervisord]
logfile=/u01/server/supervisord/logs/supervisord.log ; (main log file;default $CWD/supervisord.log)
logfile_maxbytes=50MB ; (max main logfile bytes b4 rotation;default 50MB)
logfile_backups=10 ; (num of main logfile rotation backups;default 10)
loglevel=info ; (log level;default info; others: debug,warn,trace)
pidfile=/u01/server/supervisord/temp/supervisord.pid ; (supervisord pidfile;default supervisord.pid)
nodaemon=false ; (start in foreground if true;default false)
minfds=1024 ; (min. avail startup file descriptors;default 1024)
minprocs=200 ; (min. avail process descriptors;default 200)

; the below section must remain in the config file for RPC
; (supervisorctl/web interface) to work, additional interfaces may be
; added by defining them in separate rpcinterface: sections
[rpcinterface:supervisor]
supervisor.rpcinterface_factory = supervisor.rpcinterface:make_main_rpcinterface

[supervisorctl]
serverurl=unix:///u01/server/supervisord/temp/supervisor.sock ; use a unix:// URL for a unix socket

; The below sample program section shows all possible program subsection values,
; create one or more 'real' program: sections to be able to control them under
; supervisor.

[program:wx_front]
command=/u01/server/php/bin/php /u01/server/apps/wechat/artisan queue:listen --queue=wxqueue --timeout=60 --delay=3 --memory=128 --sleep=3 --tries=0 --env=test ; the program (relative uses PATH, can take args)
process_name=%(program_name)s ; process_name expr (default %(program_name)s)
numprocs=2 ; number of processes copies to start (def 1)
;directory=/tmp ; directory to cwd to before exec (def no cwd)
;umask=022 ; umask for process (default None)
;priority=999 ; the relative start priority (default 999)
autostart=true ; start at supervisord start (default: true)
startsecs=3 ; # of secs prog must stay up to be running (def. 1)
startretries=3 ; max # of serial start failures when starting (default 3)
;autorestart=unexpected ; when to restart if exited after running (def: unexpected)
;exitcodes=0,2 ; 'expected' exit codes used with autorestart (default 0,2)
;stopsignal=QUIT ; signal used to kill process (default TERM)
;stopwaitsecs=10 ; max num secs to wait b4 SIGKILL (default 10)
;stopasgroup=false ; send stop signal to the UNIX process group (default false)
;killasgroup=false ; SIGKILL the UNIX process group (def false)
user=daemon ; setuid to this UNIX account to run the program
;redirect_stderr=true ; redirect proc stderr to stdout (default false)
stdout_logfile=/u01/server/supervisord/logs/wx_front_stdout.log ; stdout log path, NONE for none; default AUTO
stdout_logfile_maxbytes=50MB ; max # logfile bytes b4 rotation (default 50MB)
stdout_logfile_backups=5 ; # of stdout logfile backups (default 10)
;stdout_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0)
;stdout_events_enabled=false ; emit events on stdout writes (default false)
stderr_logfile=/u01/server/supervisord/logs/wx_front_stderr.log ; stderr log path, NONE for none; default AUTO
stderr_logfile_maxbytes=50MB ; max # logfile bytes b4 rotation (default 50MB)
;stderr_logfile_backups=10 ; # of stderr logfile backups (default 10)
;stderr_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0)
;stderr_events_enabled=false ; emit events on stderr writes (default false)
;environment=A="1",B="2" ; process environment additions (def no adds)
;serverurl=AUTO ; override serverurl computation (childutils)

[program:wx_admin]
command=/u01/server/php/bin/php /u01/server/apps/admin/artisan queue:listen --queue=wx_queue_admin --timeout=60 --delay=3 --memory=128 --sleep=3 --tries=0 --env=test ; the program (relative uses PATH, can take args)
process_name=%(program_name)s ; process_name expr (default %(program_name)s)
numprocs=2 ; number of processes copies to start (def 1)
autostart=true ; start at supervisord start (default: true)
startsecs=3 ; # of secs prog must stay up to be running (def. 1)
startretries=3 ; max # of serial start failures when starting (default 3)
user=daemon ; setuid to this UNIX account to run the program
stdout_logfile=/u01/server/supervisord/logs/wx_admin_stdout.log ; stdout log path, NONE for none; default AUTO
stdout_logfile_maxbytes=50MB ; max # logfile bytes b4 rotation (default 50MB)
stdout_logfile_backups=5 ; # of stdout logfile backups (default 10)
stderr_logfile=/u01/server/supervisord/logs/wx_admin_stderr.log ; stderr log path, NONE for none; default AUTO
stderr_logfile_maxbytes=50MB ; max # logfile bytes b4 rotation (default 50MB)

开机自启动
/etc/rc.local
supervisord -c /u01/server/supervisord/conf/supervisord.conf

手动启动
supervisord -c /u01/server/supervisord/conf/supervisord.conf

进程管理
1.进入cli终端

[root@mtest3 logs]# supervisorctl -c /u01/server/supervisord/conf/supervisord.conf
supervisor> 

2.查看进程状态

supervisor> status
wx_admin:0 RUNNING pid 26305, uptime 0:07:42
wx_admin:1 RUNNING pid 26304, uptime 0:07:42
wx_front:0 RUNNING pid 26307, uptime 0:07:42
wx_front:1 RUNNING pid 26306, uptime 0:07:42

3.重启superivsord服务(更改配置之后)

supervisor> reload
Really restart the remote supervisord process y/N? y
Restarted supervisord

4.关闭进程

supervisor> stop all
wx_admin:1: stopped
wx_admin:0: stopped
wx_front:1: stopped
wx_front:0: stopped

5.启动进程

supervisor> start all
wx_admin:1: started
wx_admin:0: started
wx_front:1: started
wx_front:0: started

6.查看命令行帮助(支持的命令，以及用法)

supervisor> help

default commands (type help <topic>):
=====================================
add exit open reload restart start tail 
avail fg pid remove shutdown status update 
clear maintail quit reread signal stop version

7.退出

supervisor> exit

default commands (type help <topic>):
=====================================
add exit open reload restart start tail 
avail fg pid remove shutdown status update 
clear maintail quit reread signal stop version

备注
1.配置key value必须至少包含一个空格再跟上 ; 注释符号

后记

看起来安装这个很简单，实际操作过之后，还是碰到一些意外的坑，而这些坑只有实际操作过才能发现:)

参考资料
[1] supervisord官网
http://supervisord.org/index.html

[2] supervisor github

https://github.com/Supervisor/supervisor/releases

[3] elementtree-1.2.6-20050316
http://effbot.org/downloads#elementtree

[4] meld3-0.6.5
http://www.plope.com/software/meld3/

[5] setuptools-20.2.2
https://pypi.python.org/pypi/setuptools#downloads