zoukankan      html  css  js  c++  java
  • pyhive 连接 Hive 时错误

    一、User: xx is not allowed to impersonate xxx'

    解决办法:修改 core-site.xml 文件,加入下面的内容后重启 hadoop

    <property>
        <name>hadoop.proxyuser.xx.hosts</name>
        <value>*</value>
    </property>
    
    <property>
        <name>hadoop.proxyuser.xx.groups</name>
        <value>*</value>
    </property>
    

    Tips:注意是 xx 不是 xxx

    二、ACCEPTED: waiting for AM container to be allocated, launched and register with RM.

    现象为:

    1. 查看 node 的健康状态:http://master:8088/cluster/cluster ,无活跃 node
    2. pyhive 执行 insert 命令卡住,一直处于 accept 状态。
    3. YarnApplicationState 为:ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
    4. slave yarn 日志为:Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is...

    解决办法:

    切记启动 hdfs 后,要配置启动 yarn。配置如下:

     <configuration>
        <property>  
            <name>yarn.resourcemanager.address</name>  
            <value>master:8032</value>  
        </property>  
        <property>  
            <name>yarn.resourcemanager.scheduler.address</name>  
            <value>master:8030</value>  
        </property>  
        <property>  
            <name>yarn.resourcemanager.resource-tracker.address</name>  
            <value>master:8031</value>  
        </property>
        <property>
            <name>yarn.nodemanager.aux-services</name>
            <value>mapreduce_shuffle</value>
        </property>
    </configuration>
    
  • 相关阅读:
    杭电acm1517
    杭电acm1228
    杭电acm1859
    杭电acm1124
    杭电acm1327
    CPP Templates 之 template 关键字的用法技巧
    malloc与calloc区别
    CPP Templates 之 类模板的继承
    CPP Templates 之 模板演绎的注意事项
    CPP Templates 之 局部类模板特化
  • 原文地址:https://www.cnblogs.com/xueweihan/p/9216435.html
Copyright © 2011-2022 走看看