zoukankan      html  css  js  c++  java
  • MapD建表测试(使用复制已有表的形式)

    在GPU上的测试(4个Tesla P100-SXM2-16GB)
    1.1万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_10k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    10000
    drop table flights_2008_test;
    2.20万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_200k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    200000
    drop table flights_2008_new;
    3.700万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_7M);
    报错,GPU内存溢出:
    E0627 18:37:56.306819 3148 MapDHandler.cpp:2384] Exception: Query couldn't keep the entire working set of columns in GPU memory
    Exception: Query couldn't keep the entire working set of columns in GPU memory

    在CPU上的测试(ppc64le 128核):
    1.1万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_10k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    10000
    drop table flights_2008_test;
    2.20万行测试:
    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_200k);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    200000
    drop table flights_2008_new;
    3.700万行测试:

    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_7M);
    select count(*) from flights_2008_new;
    返回:
    EXPR$0
    7009728

    4.5600万行测试:

    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_56M);
    (前期运行平稳,后来,我一个128核CPU,占用情况达百分之一万二千多,然后服务器自动freezen了,这个方法先不试了)。

    drop table flights_2008_new;
    5.1亿行测试:

    CREATE TABLE flights_2008_new AS (SELECT * FROM flights_2008_100M);
    报错:Thrift: Wed Jun 28 09:43:13 2017 TSocket::write_partial() send() <Host: localhost Port: 9091>Broken pipe
    Thrift: Wed Jun 28 09:43:13 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift: Wed Jun 28 09:43:13 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift error: connect() failed: Connection refused

    第二次尝试:

    Thrift: Wed Jun 28 10:02:52 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift: Wed Jun 28 10:02:52 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
    Thrift error: connect() failed: Connection refused

  • 相关阅读:
    3D游戏常用技巧Normal Mapping (法线贴图)原理解析——高级篇
    [工作积累] OpenGL ES3.0: glInvalidateFramebuffer
    引擎设计跟踪(九.14.2c) 最近一些小的更新
    引擎设计跟踪(九.14.2b) 骨骼动画基本完成
    最近在玩的游戏
    引擎设计跟踪(九.14.2a) 导出插件问题修复和 Tangent Space 裂缝修复
    [工作积累] Google/Amazon平台的各种坑
    [工作积累] NDK通过Java获取package name 和version
    [工作记录] Android OpenSL ES: references & AAC related
    [工作记录] Android OpenGL ES: non-square texture
  • 原文地址:https://www.cnblogs.com/laozhuang/p/7086721.html
Copyright © 2011-2022 走看看