zoukankan      html  css  js  c++  java
  • storm 使用过程中遇到的问题

    1 bolt不停重启,excutor无法启动。
    nimbus日志类似如下(), 
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[34
    34] not alive
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[4 4]
    not alive
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[40
    40] not alive
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[10
    10] not alive
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[16
    16] not alive
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[22
    22] not alive
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Executor MITAS3-74-1394565794:[28
    28] not alive
    2014-03-12 10:55:06 b.s.s.EvenScheduler [INFO] Available slots:
    (["5d105f66-1add-421b-8265-e7340a95928c" 6700]
    ["32ab1745-c260-4491-ae4d-92dcc5d14a62" 6700])
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Reassigning MITAS3-74-1394565794 to
    6 slots
    2014-03-12 10:55:06 b.s.d.nimbus [INFO] Reassign executors: [[34 34] [4 4]
    [40 40] [10 10] [16 16] [22 22] [28 28]]
    
    
    原因是:work的内存设置太小,导致excutor无法启动
    更改方法修改storm work配置,增大内存。
    ## to worker 
    worker.childopts: "-Xmx4096m"
    
    
    参考:
    I have encountered the same issue in a case of out of memory in worker
    process. Try increase the memory of the wokers by setting nimbus.childopts
    property. Also, if you are creating short living object at higher rate
    use +UseG1GC
    . Since you are saying that you hold data in your memory, I'm suspecting
    (as I said) an OutOfMemeory error. Don't cover this just by increasing the
    heap size, but also I recommend to profile your worker and see if you have
    a memory leak.
    转自:http://qnalist.com/questions/4769895/topology-restart-due-to-executor-not-alive
  • 相关阅读:
    受限玻尔兹曼机 视频
    android textview空格占位符以及一些其他占位符汇总
    几种常见的Preference总结
    Android著名开源库
    Android 常用开源库总结(持续更新)
    2019最新Android常用开源库总结(附带github链接)
    Android gradle用exclude排除引用包中的dependency引用
    Gradle3.0新指令api、provided、implementation等对比
    jar包下载网站
    mac环境下Android 反编译
  • 原文地址:https://www.cnblogs.com/catkins/p/5270376.html
Copyright © 2011-2022 走看看