文章目錄

1 離線部署規劃

離線部署主要分爲三塊

MySQL的離線部署
CM離線部署
Parcel的離線部署

2 服務器規劃

3 離線部署安裝包說明

MySql離線部署

mysql-5.7.11-linux-glibc2.5-x86_64.tat.gz
mysql-connector-java-5.1.47.jar

CM

cm-6.3.1-radhat7.tar.gz

Parcel文件

CDH-6.3.1-1.cdh6.3.1.p0.1470567-e17.parcel
CDH-6.3.1-1.cdh6.3.1.p0.1470567-e17.parcel.shal
maifest.json

JDK & jar

jdk-8u45-linux-x64.gz
mysql-connector-ajva-5.1.47.jar

4 節點初始化

4.1 host文件的修改

echo '"172.21.230.219 ifeng01" >> /ect/hosts
echo '"172.21.230.220 ifeng02" >> /ect/hosts
echo '"172.21.230.221 ifeng03" >> /ect/hosts

hostname文件也要相應修改

第一臺修改爲
echo  "ifeng01" >> /ect/hostname
 以下同理

hostname與hosts的區別

4.2 關閉防火牆和清空規則

# 關閉
sudo systemctl stop firewalld
# 禁用
sudo systemctl disable firewalld
# 清空規則
sudo iptables -F

4.3 關閉seLinux

sudo vi /etc/selinux/config

改爲

SELINUX=disabled

4.4 統一時區

timedatectl --help

# 查看時區
timedatectl list-timezones | grep Shanghai

#設置時區
timedatectl set-timezone Asia/Shanghai

4.5 時間同步

4.5.1 主從(優先)

主節點和互聯網同步，從節點與主節點同步

# 安裝ntp
yum install -y ntp

vi /etc/ntp.conf
# 增添如下兩句

# 設置如果網絡時間不可用 那麼應用本地時間
server 127.127.1.0 iburst local clock
# 設置本服務器能夠被哪些其他服務器鏈接
restrict 172.21.230.0 mask 255.255.255.0 nomodify notrap

主節點服務器啓動ntp
systemctl start ntpd
# 查看ntp狀態
systemctl stauts ntpd

# 與網絡時間進行一個驗證
ntpd -q

#slave 都用停用ntp時間
systemctl stop ntpd
systemctl disable ntpd
# 設置與Master同步
nrpdate ifeng01
# 設置每天同步一次
crontab -e

#*****:五個*代表
00 00 * * */usr/sbin/ntpdate ifeng01

4.5.2 主主主

每一臺都和互聯網同步時間

4.5.3 公司內部時鐘服務器 / Maven倉庫中心

1 & 2 中的互聯網時間--------------> 公司時鐘服務器

5 基礎軟件安裝

5.1 JDK安裝

5.1.1 創建JDK的目錄

mkdir /usr/java/

5.1.2 tar開jdk.gz

root@ifeng01 CDH6.3.1]# tar -xzvf jdk-8u181-linux-x64.tar.gz -C /usr/java

5.1.3 修正用戶和用戶組

[root@ifeng01 CDH6.3.1]# chown -R root:root /usr/java/jdk1.8.0_181/

5.1.4 配置環境變量

JAVA_HOME

echo "export JAVA_HOME=/usr/java/jdk1.8.0_181" >> /etc/profile

PATH

echo "export PATH=/usr/java/jdk1.8.0_181/bin:${PATH}" >> /etc/profile

vi /etc/profile
export JAVA_HOME=/usr/java/jdk1.8.0_181
export PATH=${JAVA_HOME}/bin:${PATH}

source /etc/profile

# 檢驗是否成功
which java

5.2 離線部署MySQL

5.2.1 tar開gz

tar開

tar -xzvf mysql-5.7.11-linux-glibc2.5-x86_64.tar.gz -C /usr/local/

重命名

mv mysql-5.7.11-linux-glibc2.5-x86_64 mysql

5.2.2 創建my.cnf文件

mkdir /usr/local/mysql/arch 
mkdir ./mysql/data 
mkdir ./mysql/tmp

vi /etc/my.cnf

[client]
port            = 3306
socket          = /usr/local/mysql/data/mysql.sock
default-character-set=utf8mb4

[mysqld]
port            = 3306
socket          = /usr/local/mysql/data/mysql.sock

skip-slave-start

skip-external-locking
key_buffer_size = 256M
sort_buffer_size = 2M
read_buffer_size = 2M
read_rnd_buffer_size = 4M
query_cache_size= 32M
max_allowed_packet = 16M
myisam_sort_buffer_size=128M
tmp_table_size=32M

table_open_cache = 512
thread_cache_size = 8
wait_timeout = 86400
interactive_timeout = 86400
max_connections = 600

# Try number of CPU's*2 for thread_concurrency
#thread_concurrency = 32 

#isolation level and default engine 
default-storage-engine = INNODB
transaction-isolation = READ-COMMITTED

server-id  = 1739
basedir     = /usr/local/mysql
datadir     = /usr/local/mysql/data
pid-file     = /usr/local/mysql/data/hostname.pid

#open performance schema
log-warnings
sysdate-is-now

binlog_format = ROW
log_bin_trust_function_creators=1
log-error  = /usr/local/mysql/data/hostname.err
log-bin = /usr/local/mysql/arch/mysql-bin
expire_logs_days = 7

innodb_write_io_threads=16

relay-log  = /usr/local/mysql/relay_log/relay-log
relay-log-index = /usr/local/mysql/relay_log/relay-log.index
relay_log_info_file= /usr/local/mysql/relay_log/relay-log.info

log_slave_updates=1
gtid_mode=OFF
enforce_gtid_consistency=OFF

# slave
slave-parallel-type=LOGICAL_CLOCK
slave-parallel-workers=4
master_info_repository=TABLE
relay_log_info_repository=TABLE
relay_log_recovery=ON

#other logs
#general_log =1
#general_log_file  = /usr/local/mysql/data/general_log.err
#slow_query_log=1
#slow_query_log_file=/usr/local/mysql/data/slow_log.err

#for replication slave
sync_binlog = 500


#for innodb options 
innodb_data_home_dir = /usr/local/mysql/data/
innodb_data_file_path = ibdata1:1G;ibdata2:1G:autoextend

innodb_log_group_home_dir = /usr/local/mysql/arch
innodb_log_files_in_group = 4
innodb_log_file_size = 1G
innodb_log_buffer_size = 200M

#根據生產需要，調整pool size 
innodb_buffer_pool_size = 12G
#innodb_additional_mem_pool_size = 50M #deprecated in 5.6
tmpdir = /usr/local/mysql/tmp

innodb_lock_wait_timeout = 1000
#innodb_thread_concurrency = 0
innodb_flush_log_at_trx_commit = 2

innodb_locks_unsafe_for_binlog=1

#innodb io features: add for mysql5.5.8
performance_schema
innodb_read_io_threads=4
innodb-write-io-threads=4
innodb-io-capacity=200
#purge threads change default(0) to 1 for purge
innodb_purge_threads=1
innodb_use_native_aio=on

#case-sensitive file names and separate tablespace
innodb_file_per_table = 1
lower_case_table_names=1

[mysqldump]
quick
max_allowed_packet = 128M

[mysql]
no-auto-rehash
default-character-set=utf8mb4

[mysqlhotcopy]
interactive-timeout

[myisamchk]
key_buffer_size = 256M
sort_buffer_size = 256M
read_buffer = 2M
write_buffer = 2M

5.2.3 創建用戶組以及用戶

# -g：指定組ID爲101
groupadd -g 101 dba

#指定用戶id 514到 dba組中
#-d 登錄時的初始目錄
useradd -u 514 -g dba -G root -d /usr/local/mysql mysqladmin

出現以下警告爲正常現象

copy 環境變量配置文件至mysqladmin用戶的home目錄中,爲了以下步驟配置個人環境變量
cp /etc/skel/.* /usr/local/mysql

5.2.4 配置環境變量

[root@localhost mysql]# vi .bashrc

# User specific environment and startup programs
export MYSQL_BASE=/usr/local/mysql
export PATH=${MYSQL_BASE}/bin:$PATH

5.2.5 賦予權限

chown mysqladmin:dba /etc/my.cnf
chmod 640 /etc/my.cnf

chown -R mysqladmin:dba /usr/local/mysql
chmod -R 755 /usr/local/mysql

5.2.6 配置開機自啓動

cd /usr/local/mysql
#將服務文件複製到init.d下，重命名爲MySQL
cp support-files/mysql.server /etc/rc.d/init.d/mysql 
# 賦權限
chmod +x /etc/rc.d/init.d/mysql

# 增加一項新的服務交由chkconfig管理
chkconfig --add mysql
# 設定在345下開啓mysql
#暫時不執行
chkconfig --level 345 mysql on

5.2.7 安裝libaio包 & 初始化DB

yum -y install libaio

切換到mysqladmin賬戶

su mysqladmin

bin/mysqld \
--defaults-file=/etc/my.cnf \
--user=mysqladmin \
--basedir=/usr/local/mysql/ \
--datadir=/usr/local/mysql/data/ \
--initialize


#在初始化時如果加上 –initial-insecure，則會創建空密碼的 root@localhost 賬號，否則會創建帶密碼的 root@localhost 賬號，密碼直接寫在 log-error 日誌文件中
#（在5.6版本中是放在 ~/.mysql_secret 文件裏，更加隱蔽，不熟悉的話可能會無所適從）

5.2.8 查看密碼 & 啓動

cd /usr/local/mysql/data
cat hostname.err | grep password

切換到mysqladmin賬號

su - mysqladmin

啓動mysql

service mysql start

登錄MySQL

mysql -uroot -p
密碼爲上圖紅線部分

應用mysql數據庫

use mysql
被提示應該重置密碼

重置密碼

alter user root@localhost identified by 'ifeng001';

賦予用戶權限

# grant 權限1,權限2,…權限n on 數據庫名稱.表名稱 to 用戶名@用戶地址 identified by ‘連接口令’;
GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'ifeng001' ;

刷新剛修改的權限

flush privileges;

5.2.9 重啓MySQL

service mysql restart

5.3 元數據庫

5.3.1 創建數據庫 & 用戶

創建CDH元數據庫用戶 amon(Activity Monitor（活動監控）)的服務的庫用戶

cteate database cmf default charcter set utf8;
create database amon default charcter set utf8;

grant all privileges on cmf.* to 'cmf'@'%' identified by '1qaz2wsx!';
grant all privileges on amon.* to 'amon'@'%' identified by '1qaz2wsx!';

flush privileges;

5.3.2 jar包

選擇第一臺部署 amon的進程那麼mysql jdbc jar

jar包目錄

mkdir -p /usr/share/java

複製jar包過去並重命名(去掉版本號)

cp mysq1-connector-java-5.1.47.jar /usr/share/java/mysql-connector-java.jar

6 CM部署 Server + agent （rpm）

6.1 tar開

# Master
[root@localhost CDH6.3.1]# tar -xzvf cm6.3.1-redhat7.tar.gz

6.2分析rpm包

cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm
cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm
cloudera-manager-server-6.3.1-1466458.el7.x86_64.rpm

#官方的postgresql 	選擇不用，採用MySQL
cloudera-manager-server-db-2-6.3.1-1466458.el7.x86_64.rpm

總結:

# server
cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm
cloudera-manager-server-6.3.1-1466458.el7.x86_64.rpm

# agent
cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm
cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm

6.3安裝rpm包

網絡環境放開用yum安裝

# 網絡環境放開 用yum安裝
yum install cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm
yum install cloudera-manager-server-6.3.1-1466458.el7.x86_64.rpm

網絡環境關閉離線部署

rpm -ivh cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm --nodeps --force
rpm -ivh cloudera-manager-server-6.3.1-1466458.el7.x86_64.rpm --nodeps --force

安裝成功

6.4配置

# cd /etc/cloudera-scm-server/

編輯db.properties文件

vi db.properties

修改5個地方


# Copyright (c) 2012 Cloudera, Inc. All rights reserved.
#
# This file describes the database connection.
#

# The database type
# Currently 'mysql', 'postgresql' and 'oracle' are valid databases.
com.cloudera.cmf.db.type=mysql

# The database host
# If a non standard port is needed, use 'hostname:port'
com.cloudera.cmf.db.host=10.103.66.115:3306

# The database name
com.cloudera.cmf.db.name=cmf

# The database user
com.cloudera.cmf.db.user=cmf

# The database user's password
com.cloudera.cmf.db.password=1qaz2wsx!

# The db setup type
# After fresh install it is set to INIT
# and will be changed post config.
# If scm-server uses Embedded DB then it is set to EMBEDDED
# If scm-server uses External DB then it is set to EXTERNAL
com.cloudera.cmf.db.setupType=EXTERNAL
~

6.5 檢測啓動

日誌存放地址

var/log/cloudera-scm-server

對比
啓動前查看

啓動

service cloudera-scm-server start

啓動後對比

查看啓動日誌

tail -F cloudera-scm-server.log

service cloudera-server status

6.4 Agent安裝

打開7180頁面後不要動
進行三臺的agent的安裝

主節點Master也需要安裝agent

yum install cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm

修改Master的文件

[root@ifeng01 x86_64]# vi /etc/cloudera-scm-agent/config.ini

[General]
# Hostname of the CM server.
server_host=ifeng01

複製Master的兩個rpm包到從節點

[root@ifeng01 x86_64]# scp cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm ifeng02:/root/CDH6.3.1/
cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm                                                                                                            100%   10MB 120.9MB/s   00:00    
[root@ifeng01 x86_64]# scp cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm ifeng03:/root/CDH6.3.1/
cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm                                                                                                            100%   10MB 100.3MB/s   00:00    
[root@ifeng01 x86_64]# scp cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm ifeng02:/root/CDH6.3.1/
cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm                                                                                                          100% 1148MB 180.3MB/s   00:06    
[root@ifeng01 x86_64]# scp cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm ifeng03:/root/CDH6.3.1/
cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm

從節點分別安裝這兩個rpm包
每臺分別安裝

yum install cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm
yum install cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm

修改兩臺從機的文件

 vi /etc/cloudera-scm-agent/config.ini

[General]
# Hostname of the CM server.
server_host=ifeng01

三臺啓動agent

service cloudera-scm-agent start

檢查啓動情況

 service cloudera-scm-agent status

6.5 Web頁面配置


默認賬戶密碼：
admin
admin

這裏選擇用免費版，其他都是下一步下一步

三臺服務器全部選擇

6.5.2 配置http parcel

Master:
yum install -y httpd

創建parcel文件夾

mkdir /var/www/html/cdh6_parcel

移動parcel到/var/www/html/cdh6_parcel

root@ifeng01 CDH6.3.1]# mv CDH-6.3.1-1.cdh6.3.1.p0.1470567-el7.parcel /var/www/html/cdh6_parcel

#把末尾的1 去掉，1代表不完整的
[root@ifeng01 CDH6.3.1]# mv CDH-6.3.1-1.cdh6.3.1.p0.1470567-el7.parcel.sha1 /var/www/html/cdh6_parcel/CDH-6.3.1-1.cdh6.3.1.p0.1470567-el7.parcel.sha

啓動httpd服務

service httpd start

正在完成部署
log存放點

/var/log

檢測網絡性能和hosts

發現一些警告

三臺機器都需要改

臨時:
sysctl vm.swappiness=10

永久:
echo 'vm.swappiness=10'>> /etc/sysctl.conf

echo never > /sys/kernel/mm/transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled

修改完畢後，重新運行檢測

首先選擇最基本配置

角色分配如下

數據庫鏈接測試通過

CDH6.3.1部署文檔——離線部署