zoukankan      html  css  js  c++  java
  • Yarn application has already exited with state FINISHED

    如果在运行spark-sql时遇到如下这样的错误,可能是因为yarn-site.xml中的配置项yarn.nodemanager.vmem-pmem-ratio值偏小,它的默认值为2.1,可以尝试改大一点再试。

    ERROR cluster.YarnClientSchedulerBackend: Yarn application has already exited with state FINISHED!

    16/10/13 10:23:19 ERROR client.TransportClient: Failed to send RPC 7614640087981520382 to /10.143.136.231:34800: java.nio.channels.ClosedChannelException

    java.nio.channels.ClosedChannelException

    16/10/13 10:23:19 ERROR cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: Sending RequestExecutors(0,0,Map()) to AM was unsuccessful

    java.io.IOException: Failed to send RPC 7614640087981520382 to /10.143.136.231:34800: java.nio.channels.ClosedChannelException

            at org.apache.spark.network.client.TransportClient$3.operationComplete(TransportClient.java:249)

            at org.apache.spark.network.client.TransportClient$3.operationComplete(TransportClient.java:233)

            at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680)

            at io.netty.util.concurrent.DefaultPromise$LateListeners.run(DefaultPromise.java:845)

            at io.netty.util.concurrent.DefaultPromise$LateListenerNotifier.run(DefaultPromise.java:873)

            at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)

            at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)

            at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)

            at java.lang.Thread.run(Thread.java:745)

  • 相关阅读:
    1373:鱼塘钓鱼(fishing)
    1261:【例9.5】城市交通路网
    1259:【例9.3】求最长不下降序列
    1260:【例9.4】拦截导弹(Noip1999)
    1258:【例9.2】数字金字塔
    1261:【例9.5】城市交通路网
    1260:【例9.4】拦截导弹(Noip1999)
    1259:【例9.3】求最长不下降序列
    1257:Knight Moves
    [HAOI2008]硬币购物(动态规划、容斥、搜索)
  • 原文地址:https://www.cnblogs.com/aquester/p/9891520.html
Copyright © 2011-2022 走看看