zoukankan      html  css  js  c++  java
  • spark查询hive表因库跟表名反引号报错Table or view not found

    使用spark查询hive表时,报错如下:

    20/03/23 11:24:10 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
    Error in query: Table or view not found: bili_manga.homepage_mangacard_user_norm_onehot; line 19 pos 6
    20/03/23 11:24:11 INFO SparkUI: Stopped Spark web UI at http://xxx:10005
    20/03/23 11:24:11 INFO YarnClientSchedulerBackend: Interrupting monitor thread
    20/03/23 11:24:12 INFO YarnClientSchedulerBackend: Shutting down all executors
    20/03/23 11:24:12 INFO YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
    20/03/23 11:24:12 INFO SchedulerExtensionServices: Stopping SchedulerExtensionServices
    (serviceOption=None,
     services=List(),

    但是使用hive引擎查询表存在且有结果的,$SPARK_HOME/conf下 也已经存放hive-site.xml文件。

    查询sql部分如下

      LEFT JOIN (
        SELECT
          *
        FROM
          `bili_manga`.`homepage_mangacard_item_norm_onehot`
        WHERE
          dt = "<%=log_date-1%>"
      ) c ON a.manga_id = c.item_id
      LEFT JOIN (
        SELECT

    将反引号去掉即可正常查询。

  • 相关阅读:
    Python:完全数
    Python:将 list 写入一个 txt 文件
    Python:对称数组
    Python:列表反转、切片
    Python:print输出间隔,换行
    Python:打印99乘法表
    Python:排序(sort / 冒泡排序)
    安装pipenv
    flex布局
    python正则表达式
  • 原文地址:https://www.cnblogs.com/songchaolin/p/12551107.html
Copyright © 2011-2022 走看看