zoukankan      html  css  js  c++  java
  • MemSQL学习笔记-类似MySQL的数据库

    http://gigaom.com/cloud/ex-facebookers-launch-memsql-to-make-your-database-fly/


    -- 多主-从

    http://www.mysqlops.com/2012/02/14/diy_multi_master_replication.html
    http://www.cnblogs.com/liuhao/archive/2012/06/26/2563702.html


    前facebook员工和前微软sql server工程师联合搞的一个分布式关系数据库
    全部内存运行,将sql转化成速度更快的c++, 原理类似HipHop


    有mysql api, 完全兼容mysql,没有学习使用成本
    速度是mysql的30倍,每秒可处理150万的事务


    官方网站:http://memsql.com/
    参考文档:http://space.itpub.net/7607759/viewspace-733545


    参考官方文档:http://developers.memsql.com/docs/1b/
    http://developers.memsql.com/docs/1b/
    -- ==============================================================

    1  Install

    wget http://download.memsql.com/814d3816f4084953833243fbf6c40d37/memsqlbin_amd64.tar.gz

    tar xvfz memsqlbin_amd64.tar.gz
    cd memsqlbin
    ./check_system
    Warning: The version of CentOS that you're using (5.5) is too low.
    MemSQL supports versions 6.0 and up.

    /home/manchun/memsqlbin/objdir/usr/local/bin/memsql-g++: /lib64/libc.so.6: version GLIBC_2.11' not found (required by /home/manchun/memsqlbin/objdir/usr/local/bin/memsql-g++)


    【解决办法】安装glibc
    [root@banggo ~]# 
    wget http://ftp.gnu.org/pub/gnu/glibc/glibc-2.11.tar.gz
    tar zxvf glibc-2.11.tar.gz
    cd glibc-2.11
    mkdir glibc-2.11-build
    退出去在别的目录执行如下编译
    /usr/src/glibc-2.11/configure --prefix=/usr/src/glibc-2.11/glibc-2.11-build/
    error:
    checking for .cfi_personality and .cfi_lsda pseudo-ops... no 
    configure: error: assembler too old, .cfi_personality support missing 


    【解决】
    参考网址 
    http://groups.google.com/group/rocks-clusters/browse_thread/thread/4c9298adecf5a335 
    http://www.caritasem.com/?p=162


    I couldn't overcome that problem, and I'm wondering how I can, but I 
    said, "hey cuda only requires glibc-2.7, so lets compile that". I went 
    ahead, and installed it into /share/apps/glibc-2.7. So here comes the 
    main question: how can I link CUDA C to the glibc-2.7 installed in 
    /share/apps ? Years ago, Tim Carlson has said "It is really not 
    practical to try and upgrade glibc to 2.5. You might want to try 
    installing a glibc 2.5 from source in /share/apps/glibc-2.5 and then 
    use LD_PRELOAD to load that library in for you CMAQ binary.", but I 
    don't know how to use LD_PRELOAD, and I would appreciate any 
    guideline. 
    [换成2.8]
    [root@banggo ~]# 
    wget http://ftp.gnu.org/pub/gnu/glibc/glibc-2.8.tar.gz
    tar zxvf glibc-2.8.tar.gz
    cd glibc-2.8
    mkdir glibc-2.8-build
    退出去在别的目录执行如下编译
    /usr/src/glibc-2.8/configure --prefix=/usr/src/glibc-2.8/glibc-2.8-build/
    make
    make install


    继续执行刚才的check_system
    [root@banggo memsqlbin]# ./check_system
    Warning: The version of CentOS that you're using (5.5) is too low.
    MemSQL supports versions 6.0 and up.
    /home/manchun/memsqlbin/objdir/usr/local/bin/memsql-g++: /lib64/libc.so.6: version 'GLIBC_2.11' not found (required by /home/manchun/memsqlbin/objdir/usr/local/bin/memsql-g++)
    【】我不得不承认,我out了,仔细一看,原来需要centos 6.0的。



    2 重新安装
    wget http://download.memsql.com/814d3816f4084953833243fbf6c40d37/memsqlbin_amd64.tar.gz
    tar xvfz memsqlbin_amd64.tar.gz
    cd memsqlbin
     ./check_system 
    报错如下:
    Warning: The recommended configuration for MemSQL is at least 8 GB of RAM


    【】解决方案:
     let "mem_mb=$(free -m | sed  -n -e '/^Mem:/s/^[^0-9]*([0-9]*) .*/1/p')";
    if [ $mem_mb -lt 1000 ]; then
        echo "Warning: The recommended configuration for MemSQL is at least 1 GB of RAM" 1>&2
        invalid='1'
    fi


    [root@memdb memsqlbin]#  ./check_system 
    System check successful

    3 登陆测试
    [root@memdb memsqlbin]#  ./memsqld --port 3308
    299691 2012-06-27 13:26:26 WARNING: SSE4.2 is not supported. Resorting to software CRC32C.
    497378 2012-06-27 13:26:27 INFO: Log level changed to 0
    120627 13:26:27 [ERROR] Fatal error: Please run MemSQL as a non-root user or specify -u root on the command line.


    120627 13:26:27 [ERROR] Aborting


    120627 13:26:27 [Note] ./memsqld: Shutdown complete


    [root@memdb memsqlbin]#  ./memsqld -u root  --port 3308
    292356 2012-06-27 13:26:54 WARNING: SSE4.2 is not supported. Resorting to software CRC32C.
    480363 2012-06-27 13:26:55 INFO: Log level changed to 0
    120627 13:26:55 [Note] ./memsqld: ready for connections.
    Version: '1b'  socket: '/tmp/memsql.sock'  port: 3308  




     4 客户端使用
    [root@memdb ~]# mysql -uroot -p -h 127.0.0.1 -P3308 --prompt="MemSQL> "
    Enter password: 
    Welcome to the MySQL monitor.  Commands end with ; or g.
    Your MySQL connection id is 253
    Server version: 5.5.8 MemSQL source distribution


    Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved.
    This software comes with ABSOLUTELY NO WARRANTY. This is free software,
    and you are welcome to modify and redistribute it under the GPL v2 license


    Type 'help;' or 'h' for help. Type 'c' to clear the current input statement.


    MemSQL> 
    MemSQL> show databases;
    +--------------------+
    | Database           |
    +--------------------+
    | information_schema |
    | memsql             |
    +--------------------+
    2 rows in set (0.00 sec)


    MemSQL> use memsql;
    Database changed
    MemSQL> show tables;
    Empty set (0.00 sec)


    MemSQL> use information_schema;
    Reading table information for completion of table and column names
    You can turn off this feature to get a quicker startup with -A


    Database changed
    MemSQL> show tables;
    +---------------------------------------+
    | Tables_in_information_schema          |
    +---------------------------------------+
    | CHARACTER_SETS                        |
    | COLLATIONS                            |
    | COLLATION_CHARACTER_SET_APPLICABILITY |
    | COLUMNS                               |
    | COLUMN_PRIVILEGES                     |
    | ENGINES                               |
    | EVENTS                                |
    | FILES                                 |
    | GLOBAL_STATUS                         |
    | GLOBAL_VARIABLES                      |
    | KEY_COLUMN_USAGE                      |
    | PARAMETERS                            |
    | PARTITIONS                            |
    | PLUGINS                               |
    | PROCESSLIST                           |
    | PROFILING                             |
    | REFERENTIAL_CONSTRAINTS               |
    | ROUTINES                              |
    | SCHEMATA                              |
    | SCHEMA_PRIVILEGES                     |
    | STATISTICS                            |
    | TABLES                                |
    | TABLESPACES                           |
    | TABLE_CONSTRAINTS                     |
    | TABLE_PRIVILEGES                      |
    | TRIGGERS                              |
    | USER_PRIVILEGES                       |
    | VIEWS                                 |
    +---------------------------------------+
    28 rows in set (0.00 sec)


    MemSQL> 


    库名字很mysql一模一样啊,好惊奇啊,居然information_schema都有,而且里面的表名字也是一模一样的。

    5 配置文件
    看看memsql有没有跟mysql类似的配置文件呢,如下,果然找到了
    [root@memdb memsqlbin]# ll /root/memsqlbin/memsql.cnf 
    -rw-r--r--. 1 1001 1001 1026  6月 18 20:07 /root/memsqlbin/memsql.cnf



    6 用户管理测试
    -- 创建新账号
    MemSQL> grant all on *.* to tim@'%' identified by "tim"  with grant option;
    Query OK, 1 row affected (0.01 sec)
    MemSQL> exit
    Bye
    -- 重新登录,输入-p密码,进不去,不输入密码一回车,反倒进去了,怪哉!
    [root@memdb memsqlbin]# mysql -utim -ptim -h 127.0.0.1 -P3308 --prompt="MemSQL> "    
    ERROR 1045 (28000): Access denied for user 'tim'@'localhost' (using password: YES)
    [root@memdb memsqlbin]# mysql -utim -p -h 127.0.0.1 -P3308 --prompt="MemSQL> "   
    Enter password: 
    Welcome to the MySQL monitor.  Commands end with ; or g.
    Your MySQL connection id is 253
    Server version: 5.5.8 MemSQL source distribution


    Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved.
    This software comes with ABSOLUTELY NO WARRANTY. This is free software,
    and you are welcome to modify and redistribute it under the GPL v2 license


    Type 'help;' or 'h' for help. Type 'c' to clear the current input statement.


    MemSQL> 




    CREATE TABLE test (
     id int(11) NOT NULL AUTO_INCREMENT,
     excel_id varchar(100) NOT NULL,
     rpt_id int(10) unsigned NOT NULL,
     acc_std tinyint(3) unsigned NOT NULL,
     prd_year int(10) unsigned NOT NULL,
     prd_qtr tinyint(3) unsigned NOT NULL,
     accumulate char(3) NOT NULL,
     biz_cd tinyint(3) unsigned NOT NULL,
     acc_cd tinyint(3) unsigned NOT NULL,
     row_num int(10) unsigned NOT NULL,
     col_num int(10) unsigned NOT NULL,
     data_id int(10) unsigned NOT NULL,
     data_trace mediumtext NOT NULL COMMENT 'trace信息',
     trace_edit tinyint(1) NOT NULL,
     upd_stmp timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
     PRIMARY KEY (id)
    ) ;

  • 相关阅读:
    并发编程-操作系统简史,多道技术
    python下的excel表格处理 内含面试题
    epoll模型的探索与实践
    nginx搭建静态网站
    面向对象基础
    python+Django 下JWT的使用
    linux的history命令
    携程apollo配置中心Quick Start
    redis哨兵
    redis的主从复制
  • 原文地址:https://www.cnblogs.com/suncoolcat/p/3283407.html
Copyright © 2011-2022 走看看