kafka 服務搭建

kafka 下載:     http://archive.apache.org/dist/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz

 

 

zookeeper 下載、安裝、配置

1、在 /kafkadir/test_do_v2/ 目錄下,下載: https://archive.apache.org/dist/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz ,並解壓到當前目錄

2、mkdir -p /kafkadir/test_do_v2/svr_cfg/zookeeper/data

3、cd zookeeper-3.4.10/conf/

4、cp zoo_sample.cfg zoo.cfg

5、vim zoo.cfg

initLimit=10
syncLimit=5
dataDir=/kafkadir/test_do_v2/svr_cfg/zookeeper/data
clientPort=2181

6、vim /etc/profile

export ZOOKEEPER_HOME=/kafkadir/test_do_v2/svr_cfg/zookeeper/
export PATH=.:$ZOOKEEPER_HOME/bin:$JAVA_HOME/bin:$PATH

7、source /etc/profile

8、啓動zookeeper服務

/kafkadir/test_do_v2/zookeeper-3.4.10/bin/zookeeper-3.4.10/bin/zkServer.sh start

 

kafaka

@ vim server.properties

broker.id=1
port=9092
host.name=localhost

log.dirs=/kafkadir/test_do_v2/svr_cfg/kafka/logs

zookeeper.connect=localhost:2181

listeners=PLAINTEXT://10.0.1.211:9092

如果需要遠程訪問則按照如下配置

advertised.listeners=PLAINTEXT://10.0.1.211:9092

host.name=0.0.0.0

 

@ vim zookeeper.properties

dataDir=/kafkadir/test_do_v2/svr_cfg/kafka/zookeeper/data
clientPort=2181
host.name=localhost

@ vim producer.properties

zookeeper.connect=localhost:2181

@ vim consumer.properties

zookeeper.connect=localhost:2181

 

測試

創建topic

bin/kafka-topics.sh --create --topic test --replication-factor 1 --partitions 1 --zookeeper localhost:2181

查看topic內容

bin/kafka-topics.sh --describe --zookeeper localhost:2181, localhost:2181, localhost:2181 --topic test

查看所有topic

bin/kafka-topics.sh --list --zookeeper localhost:2181

刪除(需要server.properties中設置delete.topic.enable=true否則只是標記刪除或者直接重啓)

bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic topicname

 

啓動順序:

cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0;./bin/zookeeper-server-start.sh config/zookeeper.properties

cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0;./bin/kafka-server-start.sh config/server.properties

其他的生產者和消費者就隨意了

cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0;bin/kafka-console-producer.sh --broker-list 10.0.1.211:9092 --topic test

cd /kafkadir/test_do_v2/kafka_2.11-0.11.0.0; bin/kafka-console-consumer.sh --bootstrap-server 10.0.1.211:9092 --topic test --from-beginning

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章