需求说明:
计算节点linux-node1.openstack：192.168.1.8
计算节点linux-node2.openstack：192.168.1.17
这两个计算节点在同一个控制节点下（192.168.1.8既是控制节点，也是其中一个计算节点），现在需要将linux-node1.openstack上的虚拟机kvm-server005迁移到liunx-node2.openstack上。
一、openstack的虚拟机线下迁移（”冷迁移“，迁移前关闭虚拟机）
操作记录如下：
linux-node1.openstack上的操作：
1）查看虚拟机
[root@linux-node1 src]# source admin-openrc.sh
[root@linux-node1 src]# nova list +--------------------------------------+----------------------------+--------+------------+-------------+--------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+----------------------------+--------+------------+-------------+--------------------+ | b6a4738d-7e01-4068-a09b-7008b612d126 | beta-new1 | ACTIVE | - | Running | flat=192.168.1.151 | | 9acdb28b-02c2-41bb-87c4-5f3a8fa008ab | dev-new-test1 | ACTIVE | - | Running | flat=192.168.1.150 | | 30e5ba3e-3942-4119-9ba6-7523cf865b6f | fangfull-backup | ACTIVE | - | Running | flat=192.168.1.152 | | 3483d9f1-4015-48d9-9837-b67ca82dd54d | kvm-server005 | ACTIVE | - | Running | flat=192.168.1.154 | | 5ec50ae5-a1f9-4425-b509-cfeb5ef62ca3 | memcache1-backup | ACTIVE | - | Running | flat=192.168.1.155 | | a5863e46-ef75-4601-a9df-505da5db58ed | memcache2-backup | ACTIVE | - | Running | flat=192.168.1.156 | | 377c536e-4d27-4447-8d9d-24c2686a73f6 | memcache3-backup | ACTIVE | - | Running | flat=192.168.1.103 | | a2893208-3ec9-4606-ab82-d7a870206cb9 | xqsj-backup | ACTIVE | - | Running | flat=192.168.1.153 | +--------------------------------------+----------------------------+--------+------------+-------------+--------------------+
2）停止待迁移虚拟机kvm-server005
[root@linux-node1 src]# nova stop 3483d9f1-4015-48d9-9837-b67ca82dd54d Request to stop server 3483d9f1-4015-48d9-9837-b67ca82dd54d has been accepted. [root@linux-node1 src]# nova list +--------------------------------------+----------------------------+--------+--------------+-------------+--------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+----------------------------+--------+--------------+-------------+--------------------+ | b6a4738d-7e01-4068-a09b-7008b612d126 | beta-new1 | ACTIVE | - | Running | flat=192.168.1.151 | | 9acdb28b-02c2-41bb-87c4-5f3a8fa008ab | dev-new-test1 | ACTIVE | - | Running | flat=192.168.1.150 | | 30e5ba3e-3942-4119-9ba6-7523cf865b6f | fangfull-backup | ACTIVE | - | Running | flat=192.168.1.152 | | 3483d9f1-4015-48d9-9837-b67ca82dd54d | kvm-server005 | SHUTOFF| - | Shutdown | flat=192.168.1.154 | | 5ec50ae5-a1f9-4425-b509-cfeb5ef62ca3 | memcache1-backup | ACTIVE | - | Running | flat=192.168.1.155 | | a5863e46-ef75-4601-a9df-505da5db58ed | memcache2-backup | ACTIVE | - | Running | flat=192.168.1.156 | | 377c536e-4d27-4447-8d9d-24c2686a73f6 | memcache3-backup | ACTIVE | - | Running | flat=192.168.1.103 | | a2893208-3ec9-4606-ab82-d7a870206cb9 | xqsj-backup | ACTIVE | - | Running | flat=192.168.1.153 | +--------------------------------------+----------------------------+--------+--------------+-------------+--------------------+
3）查看待迁虚拟机kvm-server005所在的宿主机
[root@linux-node1 src]# nova show 3483d9f1-4015-48d9-9837-b67ca82dd54d | grep 'OS-EXT-SRV-ATTR:hos' | OS-EXT-SRV-ATTR:host | linux-node1.openstack
4）登录宿主机linux-node1.openstack上,将虚拟机kvm-server005虚拟机的数据拷贝到待迁移的宿主机linux-node2.openstack上
[root@linux-node1 src]# cd /var/lib/nova/instances [root@linux-node1 instances]# ls 30e5ba3e-3942-4119-9ba6-7523cf865b6f 5ec50ae5-a1f9-4425-b509-cfeb5ef62ca3 a5863e46-ef75-4601-a9df-505da5db58ed compute_nodes 3483d9f1-4015-48d9-9837-b67ca82dd54d 9acdb28b-02c2-41bb-87c4-5f3a8fa008ab b6a4738d-7e01-4068-a09b-7008b612d126 locks 377c536e-4d27-4447-8d9d-24c2686a73f6 a2893208-3ec9-4606-ab82-d7a870206cb9 _base snapshots [root@linux-node1 instances]# rsync -e "ssh -p22" -avpgolr 3483d9f1-4015-48d9-9837-b67ca82dd54d 192.168.1.17:/var/lib/nova/instances/ sending incremental file list 3483d9f1-4015-48d9-9837-b67ca82dd54d/ 3483d9f1-4015-48d9-9837-b67ca82dd54d/console.log 3483d9f1-4015-48d9-9837-b67ca82dd54d/disk 3483d9f1-4015-48d9-9837-b67ca82dd54d/disk.info 3483d9f1-4015-48d9-9837-b67ca82dd54d/disk.swap 3483d9f1-4015-48d9-9837-b67ca82dd54d/libvirt.xml sent 381469737 bytes received 111 bytes 69358154.18 bytes/sec total size is 381422781 speedup is 1.00
目标节点linux-node2.openstack上的操作
1）查看虚拟机kvm-server005的数据有没有拷贝过来，修改权限
[root@linux-node2 instances]# pwd /var/lib/nova/instances [root@linux-node2 instances]# ll total 12 drwxr-xr-x. 2 nova nova 85 Oct 31 14:54 0944254c-1c75-4523-9751-2389d677d59c drwxr-xr-x. 2 nova nova 85 Sep 6 12:59 3483d9f1-4015-48d9-9837-b67ca82dd54d drwxr-xr-x. 2 nova nova 85 Oct 31 17:29 946b340a-28bc-492d-8b3a-59d2fea1b464 drwxr-xr-x. 2 nova nova 4096 Oct 31 17:17 _base -rw-r--r--. 1 nova nova 44 Nov 1 10:53 compute_nodes drwxr-xr-x. 2 nova nova 85 Oct 31 17:23 f6be1cb3-a694-4492-b2db-55ff9f09d843 drwxr-xr-x. 2 nova nova 4096 Oct 31 17:14 locks [root@linux-node2 instances]# chown -R nova.nova 3483d9f1-4015-48d9-9837-b67ca82dd54d/ [root@linux-node2 instances]# ll 3483d9f1-4015-48d9-9837-b67ca82dd54d/ total 372492 -rw-rw----. 1 nova nova 65214 Sep 8 13:58 console.log -rw-r--r--. 1 nova nova 381157376 Nov 1 10:59 disk -rw-r--r--. 1 nova nova 162 Sep 6 12:59 disk.info -rw-r--r--. 1 nova nova 197120 Sep 6 12:59 disk.swap -rw-r--r--. 1 nova nova 2909 Sep 6 12:59 libvirt.xml
2）登录数据库更改MySQL中的host、node字段为新的物理主机名字
[root@linux-node2 instances]# mysql -p Enter password: Welcome to the MariaDB monitor. Commands end with ; or g. Your MariaDB connection id is 4063 Server version: 10.1.17-MariaDB MariaDB Server Copyright (c) 2000, 2016, Oracle, MariaDB Corporation Ab and others. Type 'help;' or 'h' for help. Type 'c' to clear the current input statement. MariaDB [(none)]> use nova; Database changed MariaDB [nova]> update instances set host='linux-node2.openstack', node='linux-node2.openstack' where uuid='3483d9f1-4015-48d9-9837-b67ca82dd54d'; Query OK, 1 rows affected (0.01 sec) Rows matched: 1 Changed: 1 Warnings: 0 MariaDB [nova]>
3）在目标节点linux-node2.openstack上启动虚拟机，启动前重启一下该计算节点的compute服务
[root@linux-node2 instances]# systemctl restart openstack-nova-compute [root@linux-node2 instances]# nova start 3483d9f1-4015-48d9-9837-b67ca82dd54d
4）验证虚拟机所在的宿主机
[root@linux-node2 src]# nova list +--------------------------------------+--------------+--------+------------+-------------+--------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------+ | 946b340a-28bc-492d-8b3a-59d2fea1b464 | centos03 | ACTIVE | - | Running | flat=192.168.1.104 | | 0944254c-1c75-4523-9751-2389d677d59c | kvm-centos01 | ACTIVE | - | Running | flat=192.168.1.121 | | f6be1cb3-a694-4492-b2db-55ff9f09d843 | kvm-centos02 | ACTIVE | - | Running | flat=192.168.1.122 | | 3483d9f1-4015-48d9-9837-b67ca82dd54d | kvm-server005| ACTIVE | - | Running | flat=192.168.1.154 | +--------------------------------------+--------------+--------+------------+-------------+--------------------+
[root@linux-node2 src]# nova show 3483d9f1-4015-48d9-9837-b67ca82dd54d | grep 'OS-EXT-SRV-ATTR:hos'
| OS-EXT-SRV-ATTR:host | linux-node2.openstack
二、openstack的虚拟机在线迁移（”热迁移“，虚拟机在运行中迁移）
直接在控制节点上操作
1）查看虚拟机
[root@linux-node1 src]# source admin-openrc.sh [root@linux-node1 src]# nova list +--------------------------------------+----------------------------+--------+------------+-------------+--------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+----------------------------+--------+------------+-------------+--------------------+ | b6a4738d-7e01-4068-a09b-7008b612d126 | beta-new1 | ACTIVE | - | Running | flat=192.168.1.151 | | 9acdb28b-02c2-41bb-87c4-5f3a8fa008ab | dev-new-test1 | ACTIVE | - | Running | flat=192.168.1.150 | | 30e5ba3e-3942-4119-9ba6-7523cf865b6f | fangfull-backup | ACTIVE | - | Running | flat=192.168.1.152 | | 3483d9f1-4015-48d9-9837-b67ca82dd54d | kvm-server005 | ACTIVE | - | Running | flat=192.168.1.154 | | 5ec50ae5-a1f9-4425-b509-cfeb5ef62ca3 | memcache1-backup | ACTIVE | - | Running | flat=192.168.1.155 | | a5863e46-ef75-4601-a9df-505da5db58ed | memcache2-backup | ACTIVE | - | Running | flat=192.168.1.156 | | 377c536e-4d27-4447-8d9d-24c2686a73f6 | memcache3-backup | ACTIVE | - | Running | flat=192.168.1.103 | | a2893208-3ec9-4606-ab82-d7a870206cb9 | xqsj-backup | ACTIVE | - | Running | flat=192.168.1.153 | +--------------------------------------+----------------------------+--------+------------+-------------+--------------------+
2）查看待迁虚拟机kvm-server005所在的宿主机
[root@linux-node1 src]# nova show 3483d9f1-4015-48d9-9837-b67ca82dd54d | grep 'OS-EXT-SRV-ATTR:hos' | OS-EXT-SRV-ATTR:host | linux-node1.openstack
3）查看可用的计算节点
[root@linux-node1 src]# nova-manage service list
No handlers could be found for logger "oslo_config.cfg"
Binary Host Zone Status State Updated_At
.........
nova-compute linux-node1.openstack nova enabled :-) 2016-11-01 05:12:56
nova-compute linux-node2.openstack nova enabled XXX 2016-10-31 05:55:24
4）查看目标计算节点linux-node2.openstack资源
[root@linux-node1 src]# nova-manage service describe_resource linux-node2.openstack
No handlers could be found for logger "oslo_config.cfg"
HOST PROJECT cpu mem(mb) hdd
linux-node2.openstack(total) 32 64211 149
linux-node2.openstack(used_now) 6 14848 75
linux-node2.openstack(used_max) 6 14336 75
linux-node2.openstack 0cd3632df93d48d6b2c24c67f70e56b8 6 14336 75
5）执行虚拟机的在线迁移，迁移到计算节点linux-node2.openstack上
[root@linux-node1 src]# nova live-migration 3483d9f1-4015-48d9-9837-b67ca82dd54d linux-node2.openstack
6）查看迁移后虚拟机kvm-server005所在的宿主机是否已发生改变
[root@linux-node1 src]# nova show 3483d9f1-4015-48d9-9837-b67ca82dd54d | grep 'OS-EXT-SRV-ATTR:hos' | OS-EXT-SRV-ATTR:host | linux-node2.openstack
注意：
1）/etc/hosts文件提前做好主机映射，确定节点之间能互相ping通主机名。
2）利用id nova命令查看下控制节点nova的uid和gid，并记录，保证两个计算节点的id和gid是否和控制节点保持一致
如果不一致，则利用
usermod -u “控制节点的nova的uid”
gropumod -g “控制节点的nova的gid”
两条命令进行修改,同时在所有计算节点运行该命令，保证所有nova相关文件使用新的uid和gid