1、創建share type
# manila type-create default_share_type False
+----------------------+--------------------------------------+
| Property | Value |
+----------------------+--------------------------------------+
| required_extra_specs | driver_handles_share_servers : False |
| Name | default_share_type |
| Visibility | public |
| is_default | - |
| ID | 54f6bead-1254-47a9-bcf5-cb9b5e7424d2 |
| optional_extra_specs | |
| Description | None |
+----------------------+--------------------------------------+
2、創建share卷
# manila create NFS 1 --name share1
+---------------------------------------+--------------------------------------+
| Property | Value |
+---------------------------------------+--------------------------------------+
| status | creating |
| share_type_name | default_share_type |
| description | None |
| availability_zone | None |
| share_network_id | None |
| share_server_id | None |
| share_group_id | None |
| host | |
| revert_to_snapshot_support | False |
| access_rules_status | active |
| snapshot_id | None |
| create_share_from_snapshot_support | False |
| is_public | False |
| task_state | None |
| snapshot_support | False |
| id | 5019146e-ebd3-43ae-b601-f34da23a00e3 |
| size | 1 |
| source_share_group_snapshot_member_id | None |
| user_id | 4ab1c3f2bba04c169cf63a15da8ccc97 |
| name | share1 |
| share_type | e6876193-e743-43c3-968b-1af2a47f6f52 |
| has_replicas | False |
| replication_type | None |
| created_at | 2020-04-29T17:19:09.000000 |
| share_proto | NFS |
| mount_snapshot_support | False |
| project_id | 23a40789342d4de6bc06d0b0bef7069c |
| metadata | {} |
+---------------------------------------+--------------------------------------+
share卷狀態處於available
# manila list
+--------------------------------------+--------+------+-------------+-----------+-----------+--------------------+-----------------------------------+-------------------+
| ID | Name | Size | Share Proto | Status | Is Public | Share Type Name | Host | Availability Zone |
+--------------------------------------+--------+------+-------------+-----------+-----------+--------------------+-----------------------------------+-------------------+
| 5019146e-ebd3-43ae-b601-f34da23a00e3 | share1 | 1 | NFS | available | False | default_share_type | openstack4k8s@lvm#lvm-single-pool | nova |
+--------------------------------------+--------+------+-------------+-----------+-----------+--------------------+-----------------------------------+-------------------+
share卷對應的塊設備lv已經創建好,位於vg manila-volumes中
# lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
docker centos -wi-ao---- 100.00g
nfs centos -wi-ao---- 20.00g
root centos -wi-ao---- 100.00g
swap centos -wi-a----- 5.00g
swift centos -wi-ao---- 100.00g
work centos -wi-ao---- 500.00g
cinder-volumes-pool cinder-volumes twi-aotz-- 475.00g 42.11 31.75
volume-3f486c1f-85b2-4196-950a-d7435f73fcd5 cinder-volumes Vwi-aotz-- 51.00g cinder-volumes-pool 98.04
volume-5bf2a2ee-c2e3-47b0-9678-07a1488e9327 cinder-volumes Vwi-aotz-- 51.00g cinder-volumes-pool 98.04
volume-7d0ca177-2624-4b4e-9353-222fb491f8cc cinder-volumes Vwi-aotz-- 1.00g cinder-volumes-pool 1.10
volume-8e37d227-5966-4bdf-9b70-b2058f98d156 cinder-volumes Vwi-aotz-- 51.00g cinder-volumes-pool 98.04
volume-e30cc25c-375d-437f-93b6-9cfe6fff009c cinder-volumes Vwi-aotz-- 51.00g cinder-volumes-pool 98.04
share-33d31ea0-7548-4d17-9f9b-267cfbb7802b manila-volumes -wi-ao---- 1.00g
# lvdisplay /dev/manila-volumes/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b
--- Logical volume ---
LV Path /dev/manila-volumes/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b
LV Name share-33d31ea0-7548-4d17-9f9b-267cfbb7802b
VG Name manila-volumes
LV UUID iPJoB6-N2EN-dgGX-1MjT-pfDt-vePU-RbGBy9
LV Write Access read/write
LV Creation host, time openstack4k8s, 2020-04-29 13:19:09 -0400
LV Status available
# open 1
LV Size 1.00 GiB
Current LE 256
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 8192
Block device 253:21
塊設備已經在share節點mount到指定目錄
# df
Filesystem 1K-blocks Used Available Use% Mounted on
devtmpfs 131767088 0 131767088 0% /dev
tmpfs 131779316 4 131779312 1% /dev/shm
tmpfs 131779316 1133256 130646060 1% /run
tmpfs 131779316 0 131779316 0% /sys/fs/cgroup
/dev/mapper/centos-root 104806400 7618736 97187664 8% /
/dev/sda6 2086912 146264 1940648 8% /boot
/dev/sda5 2093048 11284 2081764 1% /boot/efi
/dev/mapper/centos-docker 104806400 11559680 93246720 12% /var/lib/docker
/dev/mapper/centos-nfs 20961280 33052 20928228 1% /home/nfs-server
/dev/mapper/centos-swift 104806400 33176 104773224 1% /srv/node/device1
/dev/mapper/centos-work 524032000 17803056 506228944 4% /home/work
tmpfs 26355864 0 26355864 0% /run/user/0
overlay 104806400 11559680 93246720 12% /var/lib/docker/overlay2/ba63c5a11e4e1bbd6049f1995ab932966f6221fbfd9e43df213550831d61feae/merged
/dev/dm-21 999320 2564 927944 1% /var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b
查看share詳細信息
# manila show share1
+---------------------------------------+-------------------------------------------------------------------------------------+
| Property | Value |
+---------------------------------------+-------------------------------------------------------------------------------------+
| status | available |
| share_type_name | default_share_type |
| description | None |
| availability_zone | nova |
| share_network_id | None |
| export_locations | |
| | path = 192.168.166.180:/var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b |
| | preferred = False |
| | is_admin_only = False |
| | id = d9c49e2e-0437-4e25-9c0c-15a0a3637626 |
| | share_instance_id = 33d31ea0-7548-4d17-9f9b-267cfbb7802b |
| share_server_id | None |
| share_group_id | None |
| host | openstack4k8s@lvm#lvm-single-pool |
| revert_to_snapshot_support | False |
| access_rules_status | active |
| snapshot_id | None |
| create_share_from_snapshot_support | False |
| is_public | False |
| task_state | None |
| snapshot_support | False |
| id | 5019146e-ebd3-43ae-b601-f34da23a00e3 |
| size | 1 |
| source_share_group_snapshot_member_id | None |
| user_id | 4ab1c3f2bba04c169cf63a15da8ccc97 |
| name | share1 |
| share_type | e6876193-e743-43c3-968b-1af2a47f6f52 |
| has_replicas | False |
| replication_type | None |
| created_at | 2020-04-29T17:19:09.000000 |
| share_proto | NFS |
| mount_snapshot_support | False |
| project_id | 23a40789342d4de6bc06d0b0bef7069c |
| metadata | {} |
+---------------------------------------+-------------------------------------------------------------------------------------+
3、創建access
基於客戶端ip,給客戶端賦予訪問權限,本例中爲虛擬機k8s-m2的浮動ip 192.168.100.223
# manila access-allow share1 ip 192.168.100.223
+--------------+--------------------------------------+
| Property | Value |
+--------------+--------------------------------------+
| access_key | None |
| share_id | 5019146e-ebd3-43ae-b601-f34da23a00e3 |
| created_at | 2020-04-30T09:34:47.000000 |
| updated_at | None |
| access_type | ip |
| access_to | 192.168.100.223 |
| access_level | rw |
| state | queued_to_apply |
| id | 8c472737-f2b2-4de3-b78f-ba9c049e3c2e |
| metadata | {} |
+--------------+--------------------------------------+
查看nfs export信息
# exportfs -v
/var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b
192.168.100.223(sync,wdelay,hide,no_subtree_check,sec=sys,rw,secure,no_root_squash,no_all_squash)
/home/nfs-server/static-pv1
<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,insecure,no_root_squash,no_all_squash)
/home/nfs-server
<world>(sync,wdelay,hide,no_subtree_check,sec=sys,rw,insecure,no_root_squash,no_all_squash)
exports配置文件,其他兩個export的配置項一併修改了,有點霸道
# cat /etc/exports
/var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b 192.168.100.223(rw,sync,wdelay,hide,nocrossmnt,secure,no_root_squash,no_all_squash,no_subtree_check,secure_locks,acl,no_pnfs,anonuid=65534,anongid=65534,sec=sys,rw,secure,no_root_squash,no_all_squash)
/home/nfs-server/static-pv1 *(rw,sync,wdelay,hide,nocrossmnt,insecure,no_root_squash,no_all_squash,no_subtree_check,secure_locks,acl,no_pnfs,anonuid=65534,anongid=65534,sec=sys,rw,insecure,no_root_squash,no_all_squash)
/home/nfs-server *(rw,sync,wdelay,hide,nocrossmnt,insecure,no_root_squash,no_all_squash,no_subtree_check,secure_locks,acl,no_pnfs,anonuid=65534,anongid=65534,sec=sys,rw,insecure,no_root_squash,no_all_squash)
4、使用share 卷
在k8s-m2虛擬機上掛載share卷
# mount -vt nfs 192.168.166.180:/var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b manila_mnt/
mount.nfs: timeout set for Thu Apr 30 05:38:12 2020
mount.nfs: trying text-based options 'vers=4.1,addr=192.168.166.180,clientaddr=192.168.1.243'
# df
192.168.166.180:/var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b 999424 2048 928768 1% /home/manila_mnt
# echo "hello manila" >/home/manila_mnt/test
# touch /home/manila_mnt/test
# echo "hello manila" >/home/manila_mnt/test
manila share節點上已經可以看到新增文件及內容
# cat /var/lib/manila/mnt/share-33d31ea0-7548-4d17-9f9b-267cfbb7802b/test
hello manila