kafka集羣安裝（獨立zookeeper集羣）

1 集羣環境

192.168.100.200

192.168.100.201

192.168.100.202

2 按照步驟

[root@localhost local]# tar -zxvf kafka_2.11-0.10.1.0.tgz

[root@localhost local]# cd kafka_2.11-0.10.1.0/

[root@localhost kafka_2.11-0.10.1.0]# mkdir logs

[root@localhost kafka_2.11-0.10.1.0]# cd config/

[root@localhost config]# vi server.properties

         broker.id=0

         listeners=PLAINTEXT://192.168.100.200:9092

         advertised.listeners=PLAINTEXT://192.168.100.200:9092

         log.dirs=/usr/local/kafka_2.11-0.10.1.0/logs/

         zookeeper.connect=192.168.100.200:2181,192.168.100.201:2181,192.168.100.202:2181

[root@localhost local]# scp -r /usr/local/kafka_2.11-0.10.1.0 192.168.100.201:/usr/local/

[root@localhost local]# scp -r /usr/local/kafka_2.11-0.10.1.0 192.168.100.202:/usr/local/

在其它兩個節點上修改

         broker.id=1

         listeners=PLAINTEXT://192.168.100.201:9092

         advertised.listeners=PLAINTEXT://192.168.100.201:9092

         broker.id=2

         listeners=PLAINTEXT://192.168.100.202:9092

         advertised.listeners=PLAINTEXT://192.168.100.202:9092

啓動（每一個節點）

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-server-start.sh -daemon /usr/local/kafka_2.11-0.10.1.0/config/server.properties &

[root@localhost kafka_2.11-0.10.1.0]# jps

進程名爲Kafka

3 驗證

創建一個主題wangyl，備份3，分區2

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --create --topic wangyl  --replication-factor 3 --partitions 2 --zookeeper 192.168.100.200:2181

查看主題

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --list --zookeeper 192.168.100.200:2181

生產消費模式驗證

生產端

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-console-producer.sh --broker-list 192.168.100.200:9092 --sync --topic wangyl

消費端

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-console-consumer.sh --zookeeper 192.168.100.200:2181 --topic  wangyl --from-beginning

列出該主題的詳細信息

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --describe --zookeeper 192.168.100.200:2181 --topic wangyl