zoukankan      html  css  js  c++  java
  • python 读取hive数据

    话不多说,直接上代码

    from pyhive import hivedef pyhive(hql):
        conn = hive.Connection(host='HiveServer2 host', port=10000, database='ods')
        cursor = conn.cursor()
        cursor.execute(hql)
        for result in cursor.fetchall():
            return result

    部署时遇到一个问题:

    Traceback (most recent call last):
      File "test_pyhive.py", line 7, in <module>
        from pyhive import hive
      File "/usr/lib/python2.7/site-packages/pyhive/hive.py", line 15, in <module>
        from TCLIService import TCLIService
      File "/usr/lib/python2.7/site-packages/TCLIService/TCLIService.py", line 9, in <module>
        from thrift.Thrift import TType, TMessageType, TFrozenDict, TException, TApplicationException
    ImportError: cannot import name TFrozenDict

    解决方法是:

    原因是某些包没有关联上,装包时,加上[hive]后缀

    pip install pyhive[hive]
  • 相关阅读:
    枚举
    枚举
    比特币中的密码学原理
    贪心
    dp
    二分
    mac解决matplotlib中文乱码
    Keras使用多个GPU并行
    pyspark使用-dataframe操作
    箱线图
  • 原文地址:https://www.cnblogs.com/drjava/p/10631975.html
Copyright © 2011-2022 走看看