kafka單節點多broker部署及使用
參考單節點單broker部署的文章
https://blog.csdn.net/weixin_43451620/article/details/105573713
將配置文件server.properties複製三份
cp server.properties server-1.properties
更新配置文件 server-1.properties 中參數
broker.id=1
listeners=PLAINTEXT://hadoop001:9093
log.dirs=/usr/soft/data/kafka-logs-1
cp server.properties server-2.properties
更新配置文件 server-2.properties 中參數
broker.id=2
listeners=PLAINTEXT://hadoop001:9094
log.dirs=/usr/soft/data/kafka-logs-2
cp server.properties server-3.properties
更新配置文件 server-3.properties 中參數
broker.id=3
listeners=PLAINTEXT://hadoop001:9095
log.dirs=/usr/soft/data/kafka-logs-3
啓動kafka自帶的zookeeper
./zookeeper-server-start.sh …/config/zookeeper.properties
後臺啓動的三個kafka
./kafka-server-start.sh -daemon …/config/server-1.properties &
./kafka-server-start.sh -daemon …/config/server-2.properties &
./kafka-server-start.sh -daemon …/config/server-3.properties &
–創建topic
./kafka-topics.sh --create --zookeeper hadoop001:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic
–描述topic
./kafka-topics.sh --describe --zookeeper hadoop001:2181 --topic my-replicated-topic
據圖，可以看到我們成功創建了topic
啓動生產者
./kafka-console-producer.sh --broker-list hadoop001:9093,hadoop001:9094,hadoop001:9095 --topic my-replicated-topic
啓動消費者
./kafka-console-consumer.sh --bootstrap-server hadoop001:9093 --from-beginning --topic my-replicated-topic
**注意：**在生產者客戶端輸入內容，在消費者客戶端未收到消息。瞭解到，kafka的默認端口是9092，我們將創建的topic my-replicated-topic 刪除
./kafka-topics.sh --delete --zookeeper hadoop001:2181 --topic my-replicated-topic
殺掉一起動kafka的進程，重新啓動3個kafka進程，
./kafka-server-start.sh -daemon …/config/server.properties &
./kafka-server-start.sh -daemon …/config/server-1.properties &
./kafka-server-start.sh -daemon …/config/server-2.properties &
–創建topic
./kafka-topics.sh --create --zookeeper hadoop001:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic
啓動生產者
./kafka-console-producer.sh --broker-list hadoop001:9092,hadoop001:9093,hadoop001:9094 --topic my-replicated-topic
啓動消費者
./kafka-console-consumer.sh --bootstrap-server hadoop001:9092 --from-beginning --topic my-replicated-topic
在生產者控制檯輸入內容
會在消費者控制檯收到消息
總結，kafka的默認端口號是9092，所以此次部署一定要啓動
./kafka-server-start.sh -daemon …/config/server.properties &