在windows上部署完kafka後,我又開始整合springboot...
這篇文章建立在kafka部署完的基礎上...
如果還沒安裝運行kafka可以參照《Kafka windows下安裝和使用》https://blog.csdn.net/Alex19961223/article/details/104000790
一、項目架構
二、pom.xml
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.ylz.demo</groupId>
<artifactId>kafka-test</artifactId>
<version>0.0.1-SNAPSHOT</version>
<packaging>jar</packaging>
<name>kafka-test</name>
<description></description>
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding>
<java.version>1.8</java.version>
<springboot.version>2.1.0.RELEASE</springboot.version>
</properties>
<dependencies>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-dependencies</artifactId>
<version>${springboot.version}</version>
<type>pom</type>
<scope>import</scope>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
<version>${springboot.version}</version>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-test</artifactId>
<version>${springboot.version}</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.springframework.kafka</groupId>
<artifactId>spring-kafka</artifactId>
<version>2.2.10.RELEASE</version>
</dependency>
<dependency>
<groupId>org.projectlombok</groupId>
<artifactId>lombok</artifactId>
<version>1.18.2</version>
</dependency>
<dependency>
<groupId>com.google.code.gson</groupId>
<artifactId>gson</artifactId>
<version>2.8.2</version>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-maven-plugin</artifactId>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-compiler-plugin</artifactId>
<version>2.3.2</version>
<configuration>
<source>1.8</source>
<target>1.8</target>
<encoding>UTF-8</encoding>
</configuration>
</plugin>
</plugins>
</build>
</project>
tips:kafka版本和spring版本有依賴關係,具體參照srping官方文檔 https://spring.io/projects/spring-kafka
三、消息實體類 Message.java
@Data
public class Message {
private Long id; //id
private String msg; //消息
private Date sendTime; //時間戳
}
四、消息發送類 Sender.java
@Component
@Slf4j
public class Sender {
@Autowired
private KafkaTemplate kafkaTemplate;
private Gson gson = new GsonBuilder().create();
public void send(){
Message message = new Message();
message.setId(System.currentTimeMillis());
message.setMsg("testJson: " + UUID.randomUUID().toString());
message.setSendTime(new Date());
log.info("message={}", gson.toJson(message));
kafkaTemplate.send("testJson", gson.toJson(message));
}
}
五、消息接收類 Receiver.java
@Component
@Slf4j
public class Receiver {
@KafkaListener(topics = "streamingTopic1")
public void listener(ConsumerRecord record) {
Optional kafkaMessage = Optional.ofNullable(record.value());
if (kafkaMessage.isPresent()) {
Object message = kafkaMessage.get();
log.info("record--{}", record);
log.info("message--{}", message);
}
}
}
六、springboot 啓動類 KafkaTestApplication.java
@SpringBootApplication
@EnableKafka
public class KafkaTestApplication {
public static void main(String[] args) {
ConfigurableApplicationContext context = SpringApplication.run(KafkaTestApplication.class, args);
Sender sender = context.getBean(Sender.class);
for (int i = 0; i < 3; i++) {
//調用消息發送類中的消息發送方法
sender.send();
try {
Thread.sleep(3000);
} catch (InterruptedException e) {
e.printStackTrace();
}
}
}
}
七、配置文件 application.properties
server.port=10310
#============== kafka ===================
# 指定kafka 代理地址,可以多個
spring.kafka.bootstrap-servers=127.0.0.1:9092
#=============== provider =======================
spring.kafka.producer.retries=0
# 字節數默認
spring.kafka.producer.batch-size=16384
spring.kafka.producer.buffer-memory=33554432
# 指定消息key和消息體的編解碼方式
spring.kafka.producer.key-serializer=org.apache.kafka.common.serialization.StringSerializer
spring.kafka.producer.value-serializer=org.apache.kafka.common.serialization.StringSerializer
#=============== consumer =======================
# 指定默認消費者group id
spring.kafka.consumer.group-id=test-consumer-group
spring.kafka.consumer.auto-offset-reset=earliest
spring.kafka.consumer.enable-auto-commit=true
spring.kafka.consumer.auto-commit-interval=100
# 指定消息key和消息體的編解碼方式
spring.kafka.consumer.key-deserializer=org.apache.kafka.common.serialization.StringDeserializer
spring.kafka.consumer.value-deserializer=org.apache.kafka.common.serialization.StringDeserializer
八、開始測試
1.啓動zk
2.啓動kafka
3.運行demo KafkaTestApplication.java
4.在kafka安裝目錄下打開命令窗口
5.mock一個消費者 customer, 接收程序發送的測試消息 ;
注意主題topic需要和Sender.java裏的 kafkaTemplate.send("testJson", gson.toJson(message)); topic參數保持一致
bin\windows\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic testJson
如圖,模擬的消費者成功接收到程序傳遞的json消息串
6.mock一個生產者 producer, 發送測試消息 hello kafka ;
注意主題topic需要和Receiver.java裏的@KafkaListener(topics = "streamingTopic1") topics參數保持一致
bin\windows\kafka-console-producer.bat --broker-list localhost:9092 --topic streamingTopic1
如圖,程序成功接收到生產者傳遞的消息 hello spring-kafka
參考:
1.《SpringBoot Kafka 整合使用》https://juejin.im/post/5d406a925188255d352ab24e
2. Spring for Apache Kafka https://docs.spring.io/spring-kafka/reference/html/
3. Kafka API https://docs.spring.io/spring-kafka/api/org/springframework/kafka/annotation/KafkaListener.html