zoukankan      html  css  js  c++  java
  • MapD建表测试(使用复制已有表的形式)

    在GPU上的测试(4个Tesla P100-SXM2-16GB)
    1.1万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_10k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    10000
    drop table flights_2008_test;
    2.20万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_200k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    200000
    drop table flights_2008_new;
    3.700万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_7M);
    报错,GPU内存溢出:
    E0627 18:37:56.306819 3148 MapDHandler.cpp:2384] Exception: Query couldn't keep the entire working set of columns in GPU memory
    Exception: Query couldn't keep the entire working set of columns in GPU memory

    在CPU上的测试(ppc64le 128核):
    1.1万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_10k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    10000
    drop table flights_2008_test;
    2.20万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_200k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    200000
    drop table flights_2008_new;
    3.700万行测试:

    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_7M);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    7009728

    4.5600万行测试:

    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_56M);
    (前期运行平稳,后来,我一个128核CPU,占用情况达百分之一万二千多,然后服务器自动freezen了,这个方法先不试了)。

    drop table flights_2008_new;
    5.1亿行测试:

    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_100M);
    报错:Thrift: Wed Jun 28 09:43:13 2017 TSocket::write_partial() send() <Host: localhost Port: 9091>Broken pipe
    Thrift: Wed Jun 28 09:43:13 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift: Wed Jun 28 09:43:13 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift error: connect() failed: Connection refused

    第二次尝试:

    Thrift: Wed Jun 28 10:02:52 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift: Wed Jun 28 10:02:52 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift error: connect() failed: Connection refused

  • 相关阅读:
    oracle expdp和impdp常用命令选项
    oracle expdp导出远程数据到本地
    oracle目录操作
    反射
    设置查询对话框的F7
    Uncaught TypeError: timeout.close is not a function. when try to use clearInterval
    timestamp to time 时间戳转日期
    react+antd 选项卡切换
    react antd Warning: must set key for <rc-animate> children
    微信企业号报Error: echostr校验失败,请您检查是否正确解密并输出明文
  • 原文地址:https://www.cnblogs.com/laozhuang/p/7086721.html
Copyright © 2011-2022 走看看