Ubuntu 12.04 Ceph分佈式文件系統之部署

二、   Ceph快速配置

資源：

兩臺機器：一臺server，一臺client，安裝ubuntu12.04

其中，server安裝時，另外分出兩個區，作爲osd0、osd1的存儲，沒有的話，系統安裝好後，使用loop設備虛擬出兩個也可以。

步驟：

1、服務端安裝CEPH  (MON、MDS、OSD)

2、添加key到APT中，更新sources.list，安裝ceph

#sudo wget -q -O- 'https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc' | sudo apt-key add -

#sudo echo deb http://ceph.com/debian/ $(lsb_release -sc) main | sudo tee /etc/apt/sources.list.d/ceph.list

# sudo apt-get update && sudo apt-get install ceph

3、查看版本

# ceph-v  //將顯示ceph的版本和key信息

如果沒有顯示，請執行如下命令

# sudo apt-get update && apt-get upgrade

4、在/etc/ceph/下創建ceph.conf配置文件，並將配置文件拷貝到其它服務端。

[global]

    # For version 0.55 and beyond, you must explicitly enable
    # or disable authentication with "auth" entries in [global].

    auth cluster required = none
    auth service required = none
    auth client required = none

[osd]
    osd journal size = 1000

    #The following assumes ext4 filesystem.
    filestore xattr use omap = true


    # For Bobtail (v 0.56) and subsequent versions, you may
    # add settings for mkcephfs so that it will create and mount
    # the file system on a particular OSD for you. Remove the comment `#`
    # character for the following settings and replace the values
    # in braces with appropriate values, or leave the following settings
    # commented out to accept the default values. You must specify the
    # --mkfs option with mkcephfs in order for the deployment script to
    # utilize the following settings, and you must define the 'devs'
    # option for each osd instance; see below.

    osd mkfs type = xfs
    osd mkfs options xfs = -f   # default for xfs is "-f"
    osd mount options xfs = rw,noatime # default mount option is "rw,noatime"

    # For example, for ext4, the mount option might look like this:

    #osd mkfs options ext4 = user_xattr,rw,noatime

    # Execute $ hostname to retrieve the name of your host,
    # and replace {hostname} with the name of your host.
    # For the monitor, replace {ip-address} with the IP
    # address of your host.

[mon.a]

    host = compute-01
    mon addr = 192.168.4.165:6789

[osd.0]
    host = compute-02

    # For Bobtail (v 0.56) and subsequent versions, you may
    # add settings for mkcephfs so that it will create and mount
    # the file system on a particular OSD for you. Remove the comment `#`
    # character for the following setting for each OSD and specify
    # a path to the device if you use mkcephfs with the --mkfs option.

    devs = /dev/sda7

[mds.a]
    host = compute-01

5、創建目錄

sudo mkdir -p /var/lib/ceph/osd/ceph-0

sudo mkdir -p /var/lib/ceph/osd/ceph-1

sudo mkdir -p /var/lib/ceph/mon/ceph-a

sudo mkdir -p /var/lib/ceph/mds/ceph-a

 

6、創建分區與掛載

fdisk  /dev/sda    //創建sda6分區

mkfs.xfs  -f /dev/sda7

mount  /dev/sda7  /var/lib/ceph/osd/ceph-0   (第一次必須先掛載分區寫入初始化數據)

 

7、執行初始化

sudo mkcephfs -a -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.keyring

8、啓動

# sudo service ceph -a start

9、執行健康檢查

sudo ceph health

如果返回的是 HEALTH_OK,代表成功！

出現： HEALTH_WARN 576 pgs stuck inactive; 576 pgs stuck unclean; no osds之類的，請執行：

#ceph pg dump_stuck stale

#ceph pg dump_stuck inactive

#ceph pg dump_stuck unclean

再次健康檢查是，應該是OK

 

注意：重新執行如下命令#sudo mkcephfs -a -c /etc/ceph/ceph.conf -k ceph.keyring前，所有服務端停止ceph服務在清空創建的四個目錄：/var/lib/ceph/osd/ceph-0、/var/lib/ceph/osd/ceph-1、 /var/lib/ceph/mon/ceph-a、/var/lib/ceph/mds/ceph-a

#/etc/init.d/ceph stop

# rm –frv /var/lib/ceph/osd/ceph-0/*

# rm –frv /var/lib/ceph/osd/ceph-1/*

# rm –frv /var/lib/ceph/mon/ceph-a/*

# rm –frv /var/lib/ceph/mds/ceph-a/*

三、   CephFS的使用

在客戶端上操作：

sudo mkdir /mnt/mycephfs

sudo mount -t ceph {ip-address-of-monitor}:6789:/ /mnt/mycephfs

或者

sudo mkdir /home/{username}/cephfs

sudo ceph-fuse -m {ip-address-of-monitor}:6789 /home/{username}/cephfs

# df –h   查看