kafka 下載: http://archive.apache.org/dist/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz
zookeeper 下載、安裝、配置
1、在 /kafkadir/test_do_v2/ 目錄下,下載: https://archive.apache.org/dist/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz ,並解壓到當前目錄
2、mkdir -p /kafkadir/test_do_v2/svr_cfg/zookeeper/data
3、cd zookeeper-3.4.10/conf/
4、cp zoo_sample.cfg zoo.cfg
5、vim zoo.cfg
initLimit=10
syncLimit=5
dataDir=/kafkadir/test_do_v2/svr_cfg/zookeeper/data
clientPort=2181
6、vim /etc/profile
export ZOOKEEPER_HOME=/kafkadir/test_do_v2/svr_cfg/zookeeper/
export PATH=.:$ZOOKEEPER_HOME/bin:$JAVA_HOME/bin:$PATH
7、source /etc/profile
8、啓動zookeeper服務
/kafkadir/test_do_v2/zookeeper-3.4.10/bin/zookeeper-3.4.10/bin/zkServer.sh start
kafaka
@ vim server.properties
broker.id=1
port=9092
host.name=localhost
log.dirs=/kafkadir/test_do_v2/svr_cfg/kafka/logs
zookeeper.connect=localhost:2181
listeners=PLAINTEXT://10.0.1.211:9092
如果需要遠程訪問則按照如下配置
advertised.listeners=PLAINTEXT://10.0.1.211:9092
host.name=0.0.0.0
@ vim zookeeper.properties
dataDir=/kafkadir/test_do_v2/svr_cfg/kafka/zookeeper/data
clientPort=2181
host.name=localhost
@ vim producer.properties
zookeeper.connect=localhost:2181
@ vim consumer.properties
zookeeper.connect=localhost:2181
測試
創建topic
bin/kafka-topics.sh --create --topic test --replication-factor 1 --partitions 1 --zookeeper localhost:2181
查看topic內容
bin/kafka-topics.sh --describe --zookeeper localhost:2181, localhost:2181, localhost:2181 --topic test
查看所有topic
bin/kafka-topics.sh --list --zookeeper localhost:2181
刪除(需要server.properties中設置delete.topic.enable=true否則只是標記刪除或者直接重啓)
bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic topicname
啓動順序:
cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0;./bin/zookeeper-server-start.sh config/zookeeper.properties
cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0;./bin/kafka-server-start.sh config/server.properties
其他的生產者和消費者就隨意了
cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0;bin/kafka-console-producer.sh --broker-list 10.0.1.211:9092 --topic test
cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0; bin/kafka-console-consumer.sh --bootstrap-server 10.0.1.211:9092 --topic test --from-beginning