直接将cinder服务和块设备都部署在controller节点上
在controller节点添加一块100G的块设备/dev/sdb
配置数据库
(root@localhost) [(none)]> CREATE DATABASE cinder;
Query OK, 1 row affected (0.02 sec)
(root@localhost) [(none)]> GRANT ALL PRIVILEGES ON cinder.* TO 'cinder'@'%' IDENTIFIED BY 'cinder';
Query OK, 0 rows affected (0.10 sec)
(root@localhost) [(none)]> GRANT ALL PRIVILEGES ON cinder.* TO 'cinder'@'localhost' IDENTIFIED BY 'cinder';
Query OK, 0 rows affected (0.00 sec)
(root@localhost) [(none)]> flush privileges ;
Query OK, 0 rows affected (0.04 sec)
配置cinder服务认证
创建cinder用户：
root@controller:~# openstack user create --password-prompt cinder
User Password:cinder
Repeat User Password:cinder
+----------+----------------------------------+
| Field | Value |
+----------+----------------------------------+
| email | None |
| enabled | True |
| id | cbdfbba062b6446dac61ca9b9ce67eb6 |
| name | cinder |
| username | cinder |
+----------+----------------------------------+
将admin角色添加给cinder用户:
root@controller:~# openstack role add --project service --user cinder admin
+-------+----------------------------------+
| Field | Value |
+-------+----------------------------------+
| id | 63561476dd124bc1b6fe1e4f3cb7f3dc |
| name | admin |
+-------+----------------------------------+
创建cinder的服务实体：
root@controller:~# openstack service create --name cinder --description "OpenStack Block Storage" volume
+-------------+----------------------------------+
| Field | Value |
+-------------+----------------------------------+
| description | OpenStack Block Storage |
| enabled | True |
| id | 91fafad225f1475c9b4596ec663a8d9e |
| name | cinder |
| type | volume |
+-------------+----------------------------------+
root@controller:~# openstack service create --name cinderv2 --description "OpenStack Block Storage" volumev2
+-------------+----------------------------------+
| Field | Value |
+-------------+----------------------------------+
| description | OpenStack Block Storage |
| enabled | True |
| id | 53b6766c632b43d0ae442d6e07af5a03 |
| name | cinderv2 |
| type | volumev2 |
+-------------+----------------------------------+
创建cinder服务的API endpoint：
root@controller:~# openstack endpoint create --publicurl http://controller:8776/v2/%(tenant_id)s --internalurl http://controller:8776/v2/%(tenant_id)s --adminurl http://controller:8776/v2/%(tenant_id)s --region RegionOne volume
+--------------+-----------------------------------------+
| Field | Value |
+--------------+-----------------------------------------+
| adminurl | http://controller:8776/v2/%(tenant_id)s |
| id | d9246387b6ec4f0f9a63e60c25b481f4 |
| internalurl | http://controller:8776/v2/%(tenant_id)s |
| publicurl | http://controller:8776/v2/%(tenant_id)s |
| region | RegionOne |
| service_id | 91fafad225f1475c9b4596ec663a8d9e |
| service_name | cinder |
| service_type | volume |
+--------------+-----------------------------------------+
root@controller:~# openstack endpoint create --publicurl http://controller:8776/v2/%(tenant_id)s --internalurl http://controller:8776/v2/%(tenant_id)s --adminurl http://controller:8776/v2/%(tenant_id)s --region RegionOne volumev2
+--------------+-----------------------------------------+
| Field | Value |
+--------------+-----------------------------------------+
| adminurl | http://controller:8776/v2/%(tenant_id)s |
| id | 7f4e8c7a9b794336a61013ce56ceb994 |
| internalurl | http://controller:8776/v2/%(tenant_id)s |
| publicurl | http://controller:8776/v2/%(tenant_id)s |
| region | RegionOne |
| service_id | 53b6766c632b43d0ae442d6e07af5a03 |
| service_name | cinderv2 |
| service_type | volumev2 |
+--------------+-----------------------------------------+
安装cinder-server
root@controller:~# apt-get install cinder-api cinder-scheduler python-cinderclient cinder-volume
配置cinder-server
[DEFAULT]
rpc_backend = rabbit
auth_strategy = keystone
my_ip = 10.0.0.200
[database]
connection = mysql://cinder:cinder@controller/cinder
[oslo_messaging_rabbit]
rabbit_host = controller
rabbit_userid = openstack
rabbit_password = openstack
[keystone_authtoken]
auth_uri = http://controller:5000
auth_url = http://controller:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = cinder
password = cinder
[oslo_concurrency]
lock_path = /var/lock/cinder
初始化数据库：
root@controller:~# su -s /bin/sh -c "cinder-manage db sync" cinder
重启服务：
root@controller:~# service cinder-scheduler restart
cinder-scheduler stop/waiting
cinder-scheduler start/running, process 5420
root@controller:~# service cinder-api restart
cinder-api stop/waiting
cinder-api start/running, process 5444
删除Ubuntu自带的SQLit数据库：
root@controller:~# rm -f /var/lib/cinder/cinder.sqlite
块存储配置
创建新分区：将sdb整块盘建立一个分区：
root@controller:~# fdisk /dev/sdb
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel with disk identifier 0x622b5756.
Changes will remain in memory only, until you decide to write them.
After that, of course, the previous content won't be recoverable.
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
Command (m for help): n
Partition type:
p primary (0 primary, 0 extended, 4 free)
e extended
Select (default p): p
Partition number (1-4, default 1): 1
First sector (2048-209715199, default 2048):
Using default value 2048
Last sector, +sectors or +size{K,M,G} (2048-209715199, default 209715199):
Using default value 209715199
Command (m for help): p
Disk /dev/sdb: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders, total 209715200 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x622b5756
Device Boot Start End Blocks Id System
/dev/sdb1 2048 209715199 104856576 83 Linux
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
配置LVM的物理卷：
root@controller:~# pvcreate /dev/sdb1
Physical volume "/dev/sdb1" successfully created
root@controller:~# pvdisplay
--- Physical volume ---
PV Name /dev/sdb1
VG Name cinder-volumes
PV Size 100.00 GiB / not usable 3.00 MiB
Allocatable yes
PE Size 4.00 MiB
Total PE 25599
Free PE 25599
Allocated PE 0
PV UUID bLnc53-Yv3d-samm-nGLL-riM8-TyJc-xQn0i5
创建LVM的卷组cinder-volumes：
root@controller:~# vgcreate cinder-volumes /dev/sdb1
Volume group "cinder-volumes" successfully created
root@controller:~# vgdisplay
--- Volume group ---
VG Name cinder-volumes
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 1
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 0
Open LV 0
Max PV 0
Cur PV 1
Act PV 1
VG Size 100.00 GiB
PE Size 4.00 MiB
Total PE 25599
Alloc PE / Size 0 / 0
Free PE / Size 25599 / 100.00 GiB
VG UUID B623Af-5Uru-0S81-23Cr-XOZt-ZCkq-Wh42sf
配置LVM仅仅扫描含有cinder-volume的卷组
编辑/etc/lvm/lvm.conf，在devices部分，添加一个筛选器，仅仅允许/dev/sdb设备并拒绝所有其他设备：
devices {
...
filter = [ "a/sdb/", "r/.*/"]
安装cinder
由于都部署在controller节点上，可以忽略这步
root@controller:~# apt-get install -y cinder-volume python-mysqldb
配置cinder
/etc/cinder/cinder.conf 添加：
[DEFAULT]
#启用LVM作为后端存储系统
enabled_backends = lvm
#镜像服务运行的节点
glance_host = controller
#配置LVM驱动，卷组，iscsi的协议和helper：
[lvm]
volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver
volume_group = cinder-volumes
iscsi_protocol = iscsi
iscsi_helper = tgtadm
重启服务：
root@controller:~# service tgt restart
tgt stop/waiting
tgt start/running, process 3785
root@controller:~# service cinder-volume restart
cinder-volume stop/waiting
cinder-volume start/running, process 3838
检查块存储服务启动的服务组件：
root@controller:~# cinder service-list
+------------------+----------------+------+---------+-------+----------------------------+-----------------+
| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+------------------+----------------+------+---------+-------+----------------------------+-----------------+
| cinder-scheduler | controller | nova | enabled | up | 2019-08-27T03:43:37.000000 | None |
| cinder-volume | controller | nova | enabled | up | 2019-08-27T03:42:48.000000 | None |
| cinder-volume | controller@lvm | nova | enabled | up | 2019-08-27T03:43:33.000000 | None |
+------------------+----------------+------+---------+-------+----------------------------+-----------------+
卷的管理
创建1GB的一个卷：
root@controller:~# cinder create --name demo-volume1 1
+---------------------------------------+--------------------------------------+
| Property | Value |
+---------------------------------------+--------------------------------------+
| attachments | [] |
| availability_zone | nova |
| bootable | false |
| consistencygroup_id | None |
| created_at | 2019-08-27T03:44:20.000000 |
| description | None |
| encrypted | False |
| id | 2eea737f-6d26-48d9-b396-5c40062dc606 |
| metadata | {} |
| multiattach | False |
| name | demo-volume1 |
| os-vol-host-attr:host | None |
| os-vol-mig-status-attr:migstat | None |
| os-vol-mig-status-attr:name_id | None |
| os-vol-tenant-attr:tenant_id | e2fc7b33877b4d4e844d63b4343e9d14 |
| os-volume-replication:driver_data | None |
| os-volume-replication:extended_status | None |
| replication_status | disabled |
| size | 1 |
| snapshot_id | None |
| source_volid | None |
| status | creating |
| user_id | 5726ba166bea4c9b957ed227bfd26692 |
| volume_type | None |
+---------------------------------------+--------------------------------------+
查看可用的卷：
root@controller:~# cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| ID | Status | Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| 2eea737f-6d26-48d9-b396-5c40062dc606 | available | demo-volume1 | 1 | None | false | |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
root@controller:~# nova volume-list
+--------------------------------------+-----------+--------------+------+-------------+-------------+
| ID | Status | Display Name | Size | Volume Type | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+-------------+
| 2eea737f-6d26-48d9-b396-5c40062dc606 | available | | 1 | - | |
+--------------------------------------+-----------+--------------+------+-------------+-------------+
将卷添加到实例中：
root@controller:~# nova volume-attach demo1 2eea737f-6d26-48d9-b396-5c40062dc606
+----------+--------------------------------------+
| Property | Value |
+----------+--------------------------------------+
| device | /dev/vdb |
| id | 2eea737f-6d26-48d9-b396-5c40062dc606 |
| serverId | 69eacd59-57dd-49b4-a310-b1cd98edd935 |
| volumeId | 2eea737f-6d26-48d9-b396-5c40062dc606 |
+----------+--------------------------------------+
root@controller:~# cinder list
+--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+
| ID | Status | Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+
| 2eea737f-6d26-48d9-b396-5c40062dc606 | in-use | demo-volume1 | 1 | None | false | 69eacd59-57dd-49b4-a310-b1cd98edd935 |
+--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+
root@controller:~# nova volume-list
+--------------------------------------+--------+--------------+------+-------------+--------------------------------------+
| ID | Status | Display Name | Size | Volume Type | Attached to |
+--------------------------------------+--------+--------------+------+-------------+--------------------------------------+
| 2eea737f-6d26-48d9-b396-5c40062dc606 | in-use | | 1 | - | 69eacd59-57dd-49b4-a310-b1cd98edd935 |
+--------------------------------------+--------+--------------+------+-------------+--------------------------------------+