zoukankan      html  css  js  c++  java
  • Kylin build cube step 2 报错

    Hive 1.2.1

    HBase

    0.98Kylin 1.5.1

    Hadoop 2.5.1

    2016-08-14 15:24:22,893 INFO org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
    2016-08-14 15:24:22,902 INFO org.apache.hadoop.io.retry.RetryInvocationHandler: Exception while invoking registerNodeManager of class ResourceTrackerPBClientImpl over rm2 after 1 fail over attempts. Trying to fail over after sleeping for 37241ms.
    java.net.ConnectException: Call From bigdataspark/192.168.184.178 to bigdatahadoop:8031 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)


    2016-08-14 16:40:17,858 INFO  [pool-3-thread-2] client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
    2016-08-14 16:40:19,574 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    2016-08-14 16:40:20,576 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    2016-08-14 16:40:21,581 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    2016-08-14 16:40:22,582 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    2016-08-14 16:40:23,584 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    2016-08-14 16:40:24,586 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
    2016-08-14 16:40:25,589 INFO  [pool-3-thread-2] ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)


    2016-08-14 13:45:34,681 INFO  [pool-3-thread-4] execution.AbstractExecutable:114 :  -conf /opt/apache-kylin-1.5.1-bin/conf/kylin_job_conf.xml -cubename kylin_sales_cube -output /kylin/kylin_metadata/kylin-ae237949-1db9-4935-b232-ae93cbdaccda/kylin_sales_cube/fact_distinct_columns -segmentname 20120101000000_20130101000000 -statisticsenabled true -statisticsoutput /kylin/kylin_metadata/kylin-ae237949-1db9-4935-b232-ae93cbdaccda/kylin_sales_cube/statistics -statisticssamplingpercent 100 -jobname Kylin_Fact_Distinct_Columns_kylin_sales_cube_Step
    2016-08-14 13:46:23,975 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:47:23,572 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:48:23,567 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:49:23,585 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:50:23,587 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:51:23,575 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:52:23,577 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:53:23,576 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:54:23,570 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:55:23,573 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:56:23,574 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:57:23,572 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:58:23,572 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 13:59:23,569 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:00:23,571 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:01:23,572 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:02:23,584 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:03:23,594 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:04:23,588 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:05:23,572 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 1 others
    2016-08-14 14:05:50,360 ERROR [pool-3-thread-4] execution.AbstractExecutable:125 : error execute MapReduceExecutable{id=ae237949-1db9-4935-b232-ae93cbdaccda-01, name=Extract Fact Table Distinct Columns, state=RUNNING}
    java.net.ConnectException: Call From bigdatacloud/192.168.184.168 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at sun.reflect.GeneratedConstructorAccessor59.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)
        at org.apache.hadoop.ipc.Client.call(Client.java:1351)
        at org.apache.hadoop.ipc.Client.call(Client.java:1300)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
        at com.sun.proxy.$Proxy51.getNewApplication(Unknown Source)
        at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:167)
        at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
        at com.sun.proxy.$Proxy52.getNewApplication(Unknown Source)
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:127)
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:135)
        at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID(ResourceMgrDelegate.java:175)
        at org.apache.hadoop.mapred.YARNRunner.getNewJobID(YARNRunner.java:229)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:355)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
        at org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:147)
        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:96)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
        at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
    Caused by: java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:547)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:642)
        at org.apache.hadoop.ipc.Client$Connection.access$2600(Client.java:314)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1399)
        at org.apache.hadoop.ipc.Client.call(Client.java:1318)
        ... 33 more
    2016-08-14 14:05:50,823 INFO  [pool-3-thread-4] manager.ExecutableManager:274 : job id:ae237949-1db9-4935-b232-ae93cbdaccda-01 from RUNNING to ERROR
    2016-08-14 14:05:51,037 INFO  [pool-3-thread-4] manager.ExecutableManager:274 : job id:ae237949-1db9-4935-b232-ae93cbdaccda from RUNNING to ERROR
    2016-08-14 14:05:51,037 WARN  [pool-3-thread-4] execution.AbstractExecutable:224 : no need to send email, user list is empty
    2016-08-14 14:05:51,085 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:06:23,636 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:07:23,588 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:08:23,621 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:09:23,599 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:10:23,606 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:11:23,639 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:12:23,580 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others
    2016-08-14 14:13:23,589 INFO  [pool-2-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others


  • 相关阅读:
    Java实现 蓝桥杯VIP 算法训练 一元三次方程
    Java实现 蓝桥杯VIP 算法训练 乘法表
    Java实现 蓝桥杯VIP 算法训练 矩阵加法
    Java实现 蓝桥杯VIP 算法训练 一元三次方程
    Java实现 蓝桥杯VIP 算法训练 平方计算
    Java实现 蓝桥杯VIP 算法训练 平方计算
    Java实现 蓝桥杯VIP 算法训练 平方计算
    Java实现 蓝桥杯VIP 算法训练 乘法表
    Java实现 蓝桥杯VIP 算法训练 乘法表
    监管只是压倒网盘业务的一根稻草,但不是主要原因(答案只有一个:成本!)
  • 原文地址:https://www.cnblogs.com/TendToBigData/p/10501395.html
Copyright © 2011-2022 走看看