zoukankan      html  css  js  c++  java
  • 5.airflow问题

    1.

    Traceback (most recent call last):
      File "/usr/bin/airflow", line 28, in <module>
        args.func(args)
      File "/usr/lib/python2.7/site-packages/airflow/bin/cli.py", line 858, in serve_logs
        host='0.0.0.0', port=WORKER_LOG_SERVER_PORT)
      File "/usr/lib64/python2.7/site-packages/flask/app.py", line 843, in run
        run_simple(host, port, self, **options)
      File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 736, in run_simple
        inner()
      File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 696, in inner
        fd=fd)
      File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 590, in make_server
        passthrough_errors, ssl_context, fd=fd)
      File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 501, in __init__
        HTTPServer.__init__(self, (host, int(port)), handler)
      File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
        self.server_bind()
      File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
        SocketServer.TCPServer.server_bind(self)
      File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
        self.socket.bind(self.server_address)
      File "/usr/lib64/python2.7/socket.py", line 224, in meth
        return getattr(self._sock,name)(*args)
    socket.error: [Errno 98] Address already in use
    

    上面报了WORKER_LOG_SERVER_PORT这个,查下配置文件,是celeryexecutor像master合并日志的端口。
    用root执行:

    [root@bqdpsit1 ~]# netstat -apn | grep 8793
    tcp        0      0 0.0.0.0:8793            0.0.0.0:*               LISTEN      85717/airflow serve 
    [root@bqdpsit1 ~]# 
    [root@bqdpsit1 ~]# ps -ef|grep 85717
    root      85717      1  0 09:33 ?        00:00:01 /usr/bin/python /usr/bin/airflow serve_logs
    root      90578  90367  0 09:58 pts/15   00:00:00 grep --color=auto 85717
    [root@bqdpsit1 ~]# kill 85717
    

    可以看到原因是:之前错误的用root执行了airflow worker命令,启动了一个服务,占了这个端口。kill掉后用bqadm启动airflow worker即可。





  • 相关阅读:
    使用 PIVOT 和 UNPIVOT 行转列 列转行 报表统计 函数
    HAVING 子句 (SQL Server Compact)
    浅谈C#抽象类和C#接口
    大型高并发高负载网站的系统架构
    瞬时响应:网站的高性能架构
    Python之Subprocess模块
    Python之JSON序列
    Saltstack生产案例之系统初始化
    Saltstack配置管理
    CentOS6.5安装配置PPTP
  • 原文地址:https://www.cnblogs.com/skyrim/p/7456175.html
Copyright © 2011-2022 走看看