kafka啓動異常kafka.common.InconsistentBrokerIdException

原創

2020-06-27 11:35

kafka在搭建完全分佈式集羣的過程中，主機把Kafka包發送到從機，修改配置文件後出現kafka進程啓動失敗的情況，異常的代碼如下所示：

[2019-10-14 11:08:51,263] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,263] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,263] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,263] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,263] INFO Client environment:os.version=2.6.32-431.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,266] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,266] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,266] INFO Client environment:user.dir=/export/servers/kafka_2.11-2.1.1/config (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,268] INFO Initiating client connection, connectString=192.168.141.130:2181,192.168.141.140:2181,192.168.141.150:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@1623b78d (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:51,308] INFO [ZooKeeperClient] Waiting until connected. (kafka.zookeeper.ZooKeeperClient)
[2019-10-14 11:08:51,315] INFO Opening socket connection to server master.hadoop.com/192.168.141.130:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2019-10-14 11:08:51,329] INFO Socket connection established to master.hadoop.com/192.168.141.130:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2019-10-14 11:08:51,340] INFO Session establishment complete on server master.hadoop.com/192.168.141.130:2181, sessionid = 0x16dc837c4350002, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2019-10-14 11:08:51,369] INFO [ZooKeeperClient] Connected. (kafka.zookeeper.ZooKeeperClient)
[2019-10-14 11:08:51,996] INFO Cluster ID = uY2mOQcSRAecyBnDLqDl1g (kafka.server.KafkaServer)
[2019-10-14 11:08:52,003] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.common.InconsistentBrokerIdException: Configured broker.id 2 doesn't match stored broker.id 0 in meta.properties. If you moved your data, make sure your configured broker.id matches. If you intend to create a new broker, you should remove all data in your data directories (log.dirs).
        at kafka.server.KafkaServer.getBrokerIdAndOfflineDirs(KafkaServer.scala:686)
        at kafka.server.KafkaServer.startup(KafkaServer.scala:209)
        at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
        at kafka.Kafka$.main(Kafka.scala:75)
        at kafka.Kafka.main(Kafka.scala)
[2019-10-14 11:08:52,006] INFO shutting down (kafka.server.KafkaServer)
[2019-10-14 11:08:52,008] INFO [ZooKeeperClient] Closing. (kafka.zookeeper.ZooKeeperClient)
[2019-10-14 11:08:52,014] INFO EventThread shut down for session: 0x16dc837c4350002 (org.apache.zookeeper.ClientCnxn)
[2019-10-14 11:08:52,014] INFO Session: 0x16dc837c4350002 closed (org.apache.zookeeper.ZooKeeper)
[2019-10-14 11:08:52,016] INFO [ZooKeeperClient] Closed. (kafka.zookeeper.ZooKeeperClient)
[2019-10-14 11:08:52,019] INFO shut down completed (kafka.server.KafkaServer)
[2019-10-14 11:08:52,020] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2019-10-14 11:08:52,025] INFO shutting down (kafka.server.KafkaServer)

kafka啓動異常的原因是，主機的Kafka配置完成後進行了相關的測試，日誌文件中生成了主機相應的文件，造成從機啓動Kafka進程的時候broker.id 不能匹配meta.properties造成的。

解決方案：進入自己的配置文件conf下面，找到自己的server.properties配置，編輯查看自己日誌文件的配置目錄，然後刪除日誌文件下面主機生成的文件，然後重新啓動Kafka就可以了。
日誌文件的配置目錄如下：
主機生成的日誌文件：

重新啓動後生成的文件信息：

重新生成了meta.properties文件中有了broker.id的信息