文章目錄
1. 初始化環境準備
安裝jdk，安裝zookeeper並保證zk服務正常啓動
2. 下載安裝包並上傳解壓
node01執行以下命令，下載並解壓
[root@node01 ~]# cd /export/soft
[root@node01 soft]# wget http://archive.apache.org/dist/kafka/1.0.0/kafka_2.11-1.0.0.tgz
[root@node01 soft]# tar –zxvf kafka_2.11-1.0.0.tgz -C /export/servers/
3. node01服務器修改kafka配置文件
node01執行以下命令進入到kafka的配置文件目錄，修改配置文件
node01執行以下命令創建數據文件存放目錄
[root@node01 ~]# mkdir -p /export/servers/kafka_2.11-1.0.0/logs
[root@node01 ~]# cd /export/servers/kafka_2.11-1.0.0/config
[root@node01 config]# vim server.properties
broker.id=0
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/export/servers/kafka_2.11-1.0.0/logs
num.partitions=2
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.flush.interval.messages=10000
log.flush.interval.ms=1000
log.retention.hours=168
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
zookeeper.connect=node01:2181,node02:2181,node03:2181
zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0
delete.topic.enable=true
host.name=node01
4. 安裝包分發到其他服務器上面去
node01執行以下命令，將node01服務器的kafka安裝包發送到node02和node03服務器上面去
[root@node01 ~]# cd /export/servers/
[root@node01 servers]# scp -r kafka_2.11-1.0.0/ node02:$PWD
[root@node01 servers]# scp -r kafka_2.11-1.0.0/ node03:$PWD
5. node02與node03服務器修改配置文件
node02與node03服務器修改kafka配置文件
node02使用以下命令修改kafka配置文件
[root@node02 ~]# cd /export/servers/kafka_2.11-1.0.0/config
[root@node02 config]# vim server.properties
broker.id=1
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/export/servers/kafka_2.11-1.0.0/logs
num.partitions=2
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.flush.interval.messages=10000
log.flush.interval.ms=1000
log.retention.hours=168
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
zookeeper.connect=node01:2181,node02:2181,node03:2181
zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0
delete.topic.enable=true
host.name=node02
node03使用以下命令修改kafka配置文件
[root@node03 ~]# cd /export/servers/kafka_2.11-1.0.0/config
[root@node03 config]# vim server.properties
broker.id=2
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/export/servers/kafka_2.11-1.0.0/logs
num.partitions=2
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.flush.interval.messages=10000
log.flush.interval.ms=1000
log.retention.hours=168
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
zookeeper.connect=node01:2181,node02:2181,node03:2181
zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0
delete.topic.enable=true
host.name=node03
6. kafka集羣啓動與停止
注意事項：在kafka啓動前，一定要讓zookeeper啓動起來。
node01執行以下命令將kafka進程啓動在後臺
[root@node01 ~]# cd /export/servers/kafka_2.11-1.0.0
[root@node01 kafka_2.11-1.0.0]# nohup bin/kafka-server-start.sh config/server.properties 2>&1 &
node02執行以下命令將kafka進程啓動在後臺
[root@node02 ~]# cd /export/servers/kafka_2.11-1.0.0
[root@node02 kafka_2.11-1.0.0]# nohup bin/kafka-server-start.sh config/server.properties 2>&1 &
node03執行以下命令將kafka進程啓動在後臺
[root@node03 ~]# cd /export/servers/kafka_2.11-1.0.0
[root@node03 kafka_2.11-1.0.0]# nohup bin/kafka-server-start.sh config/server.properties 2>&1 &
三臺機器也可以執行以下命令停止kafka集羣
[root@node01 ~]# cd /export/servers/kafka_2.11-1.0.0
[root@node02 kafka_2.11-1.0.0]# bin/kafka-server-stop.sh
此操作過於繁瑣，簡便方式 —> Kafka一鍵啓動腳本