zoukankan      html  css  js  c++  java
  • MySQL Online DDL 工具之pt-online-schema-change

    MySQL DDL:
    DDL是一个令所有MySQL dDBA 诟病的一个功能,因为在MySQL中在对表进行dDDL时,会锁表,当表比较小比如小于1W行时,对前端影响较小,当时遇到千万级别的表,就会影响前端应用对表的写操作!


    InnoDB引擎是通过以下步骤来进行DDL的:
    1、按照原始表(original_table)的表结构和DDL语句,新建一个不可见的临时表(tmp_table)
    2、在原表上加write lock,阻塞所有更新操作(insert、delete、update等)
    3、执行insert into tmp_table select * from original_table
    4、rename original_table和tmp_table,最后drop original_table
    5、释放 write lock。
    可以看见在InnoDB执行DDL的时候,原表是只能读不能写的。为此 perconal 推出一个工具 pt-online-schema-change ,其特点是修改过程中不会造成读写阻塞。


    工作原理:
    如果表有外键,除非使用 --alter-foreign-keys-method 指定特定的值,否则工具不予执行。
    1 创建一个和你要执行 alter 操作的表一样的空表结构。
    2 执行表结构修改,然后从原表中的数据到copy到 表结构修改后的表,
    3 在原表上创建触发器将 copy 数据的过程中,在原表的更新操作 更新到新表.
       注意:如果表中已经定义了触发器这个工具就不能工作了。
    4 copy 完成以后,用rename table 新表代替原表,默认删除原表。


    用法介绍:
    pt-online-schema-change [OPTIONS] DSN
    options 可以自行查看 help,DNS 为你要操作的数据库和表。这里有两个参数需要介绍一下:
    --dry-run 
     这个参数不建立触发器,不拷贝数据,也不会替换原表。只是创建和更改新表。
    --execute 
    这个参数的作用和前面工作原理的介绍的一样,会建立触发器,来保证最新变更的数据会影响至新表。注意:如果不加这个参数,这个工具会在执行一些检查后退出。


    依赖条件:
    操作的表必须有主键否则 报如下错误:
    [root@hank-yoon ~]# pt-online-schema-change -u root -pyoon   -h127.0.0.1 --alter='add column vname varchar(20)' --execute D=yoon,t=yoon     
    No slaves found.  See --recursion-method if host hank-yoon.com has slaves.
    Not checking slave lag because no slaves were found and --check-slave-lag was not specified.
    Operation, tries, wait:
      copy_rows, 10, 0.25
      create_triggers, 10, 1
      drop_triggers, 10, 1
      swap_tables, 10, 1
      update_foreign_keys, 10, 1
    Altering `yoon`.`yoon`...
    Creating new table...
    Created new table yoon._yoon_new OK.
    Altering new table...
    Altered `yoon`.`_yoon_new` OK.
    2016-01-08T17:51:43 Dropping new table...
    2016-01-08T17:51:43 Dropped new table OK.
    `yoon`.`yoon` was not altered.
    The new table `yoon`.`_yoon_new` does not have a PRIMARY KEY or a unique index which is required for the DELETE trigger.


    字段vname没有添加成功!
    mysql> show create table yoonG
    *************************** 1. row ***************************
           Table: yoon
    Create Table: CREATE TABLE `yoon` (
      `actor_id` smallint(8) unsigned NOT NULL DEFAULT '0',
      `first_name` varchar(45) NOT NULL,
      `last_name` varchar(45) NOT NULL,
      `last_update` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP
    ) ENGINE=InnoDB DEFAULT CHARSET=utf8


    添加主键:
    mysql> alter table yoon modify actor_id smallint(8) unsigned primary key;
    Query OK, 0 rows affected (0.06 sec)
    Records: 0  Duplicates: 0  Warnings: 0


    [root@hank-yoon ~]# pt-online-schema-change -u root -pyoon   -h127.0.0.1 --alter='add column vname varchar(20)' --execute D=yoon,t=yoon
    No slaves found.  See --recursion-method if host hank-yoon.com has slaves.
    Not checking slave lag because no slaves were found and --check-slave-lag was not specified.
    Operation, tries, wait:
      copy_rows, 10, 0.25
      create_triggers, 10, 1
      drop_triggers, 10, 1
      swap_tables, 10, 1
      update_foreign_keys, 10, 1
    Altering `yoon`.`yoon`...
    Creating new table...
    Created new table yoon._yoon_new OK.
    Altering new table...
    Altered `yoon`.`_yoon_new` OK.
    2016-01-08T17:57:09 Creating triggers...
    2016-01-08T17:57:09 Created triggers OK.
    2016-01-08T17:57:09 Copying approximately 200 rows...
    2016-01-08T17:57:09 Copied rows OK.
    2016-01-08T17:57:09 Swapping tables...
    2016-01-08T17:57:09 Swapped original and new tables OK.
    2016-01-08T17:57:09 Dropping old table...
    2016-01-08T17:57:09 Dropped old table `yoon`.`_yoon_old` OK.
    2016-01-08T17:57:09 Dropping triggers...
    2016-01-08T17:57:09 Dropped triggers OK.
    Successfully altered `yoon`.`yoon`.




    mysql> show create table yoonG
    *************************** 1. row ***************************
           Table: yoon
    Create Table: CREATE TABLE `yoon` (
      `actor_id` smallint(8) unsigned NOT NULL,
      `first_name` varchar(45) NOT NULL,
      `last_name` varchar(45) NOT NULL,
      `last_update` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
      `vname` varchar(20) DEFAULT NULL,
      PRIMARY KEY (`actor_id`)
    ) ENGINE=InnoDB DEFAULT CHARSET=utf8




    添加多个字段:
    [root@hank-yoon ~]# pt-online-schema-change -u root -pyoon   -h127.0.0.1 --alter='add column aname varchar(20),add column bname varchar(30)' --execute D=yoon,t=yoon  
    No slaves found.  See --recursion-method if host hank-yoon.com has slaves.
    Not checking slave lag because no slaves were found and --check-slave-lag was not specified.
    Operation, tries, wait:
      copy_rows, 10, 0.25
      create_triggers, 10, 1
      drop_triggers, 10, 1
      swap_tables, 10, 1
      update_foreign_keys, 10, 1
    Altering `yoon`.`yoon`...
    Creating new table...
    Created new table yoon._yoon_new OK.
    Altering new table...
    Altered `yoon`.`_yoon_new` OK.
    2016-01-08T18:04:25 Creating triggers...
    2016-01-08T18:04:25 Created triggers OK.
    2016-01-08T18:04:25 Copying approximately 200 rows...
    2016-01-08T18:04:25 Copied rows OK.
    2016-01-08T18:04:25 Swapping tables...
    2016-01-08T18:04:26 Swapped original and new tables OK.
    2016-01-08T18:04:26 Dropping old table...
    2016-01-08T18:04:26 Dropped old table `yoon`.`_yoon_old` OK.
    2016-01-08T18:04:26 Dropping triggers...
    2016-01-08T18:04:26 Dropped triggers OK.
    Successfully altered `yoon`.`yoon`.


    mysql> show create table yoonG
    *************************** 1. row ***************************
           Table: yoon
    Create Table: CREATE TABLE `yoon` (
      `actor_id` smallint(8) unsigned NOT NULL,
      `first_name` varchar(45) NOT NULL,
      `last_name` varchar(45) NOT NULL,
      `last_update` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
      `vname` varchar(20) DEFAULT NULL,
      `aname` varchar(20) DEFAULT NULL,
      `bname` varchar(30) DEFAULT NULL,
      PRIMARY KEY (`actor_id`)
    ) ENGINE=InnoDB DEFAULT CHARSET=utf8




    删除字段:
    [root@hank-yoon ~]# pt-online-schema-change -u root -pyoon   -h127.0.0.1 --alter='drop column aname,drop column bname' --execute D=yoon,t=yoon
    No slaves found.  See --recursion-method if host hank-yoon.com has slaves.
    Not checking slave lag because no slaves were found and --check-slave-lag was not specified.
    Operation, tries, wait:
      copy_rows, 10, 0.25
      create_triggers, 10, 1
      drop_triggers, 10, 1
      swap_tables, 10, 1
      update_foreign_keys, 10, 1
    Altering `yoon`.`yoon`...
    Creating new table...
    Created new table yoon._yoon_new OK.
    Altering new table...
    Altered `yoon`.`_yoon_new` OK.
    2016-01-08T18:05:45 Creating triggers...
    2016-01-08T18:05:45 Created triggers OK.
    2016-01-08T18:05:45 Copying approximately 200 rows...
    2016-01-08T18:05:45 Copied rows OK.
    2016-01-08T18:05:45 Swapping tables...
    2016-01-08T18:05:45 Swapped original and new tables OK.
    2016-01-08T18:05:45 Dropping old table...
    2016-01-08T18:05:45 Dropped old table `yoon`.`_yoon_old` OK.
    2016-01-08T18:05:45 Dropping triggers...
    2016-01-08T18:05:46 Dropped triggers OK.
    Successfully altered `yoon`.`yoon`.




    添加索引:
    [root@hank-yoon ~]# pt-online-schema-change -u root -pyoon   -h127.0.0.1 --alter='add key index_first(first_name)' --execute D=yoon,t=yoon   No slaves found.  See --recursion-method if host hank-yoon.com has slaves.
    Not checking slave lag because no slaves were found and --check-slave-lag was not specified.
    Operation, tries, wait:
      copy_rows, 10, 0.25
      create_triggers, 10, 1
      drop_triggers, 10, 1
      swap_tables, 10, 1
      update_foreign_keys, 10, 1
    Altering `yoon`.`yoon`...
    Creating new table...
    Created new table yoon._yoon_new OK.
    Altering new table...
    Altered `yoon`.`_yoon_new` OK.
    2016-01-08T18:06:38 Creating triggers...
    2016-01-08T18:06:38 Created triggers OK.
    2016-01-08T18:06:38 Copying approximately 200 rows...
    2016-01-08T18:06:38 Copied rows OK.
    2016-01-08T18:06:38 Swapping tables...
    2016-01-08T18:06:38 Swapped original and new tables OK.
    2016-01-08T18:06:38 Dropping old table...
    2016-01-08T18:06:38 Dropped old table `yoon`.`_yoon_old` OK.
    2016-01-08T18:06:38 Dropping triggers...
    2016-01-08T18:06:38 Dropped triggers OK.
    Successfully altered `yoon`.`yoon`.

  • 相关阅读:
    VS2015快捷键
    layui radio 监听
    jsvascript === 和==的区别
    bootstrap table checkbox 根据值选中、禁用等
    table 中 display为 block 时 tbody 失去宽度
    打包成Zip
    Server.MapPath()用法
    JS比较当前时间是否在指定时间段内
    从多张表获取数据,重组DataTable,根据重组路径,打包下载文件。
    checkbox 根据值选中
  • 原文地址:https://www.cnblogs.com/hankyoon/p/5169817.html
Copyright © 2011-2022 走看看