php-rdkafka手动提交偏移量

在项目中使用php-rdkafka的高级消费者时，发现设置了：

$topicConf->set('enable.auto.commit', 'false');

没有效果，还是会自动提交offset，查了各种资料，正确的应该是这样设置：

$conf->set('enable.auto.commit', 'false');

相关说明见文档:https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md

附上示例：

<?php
 
$conf = new RdKafka\Conf();
 
// Set a rebalance callback to log partition assignments (optional)
$conf->setRebalanceCb(function (RdKafka\KafkaConsumer $kafka, $err, array $partitions = null) {
    switch ($err) {
        case RD_KAFKA_RESP_ERR__ASSIGN_PARTITIONS:
            echo "Assign: ";
            var_dump($partitions);
            $kafka->assign($partitions);
            break;
 
         case RD_KAFKA_RESP_ERR__REVOKE_PARTITIONS:
             echo "Revoke: ";
             var_dump($partitions);
             $kafka->assign(NULL);
             break;
 
         default:
            throw new \Exception($err);
    }
});
 
// Configure the group.id. All consumer with the same group.id will consume
// different partitions.
$conf->set('group.id', 'myConsumerGroup');
 
// Initial list of Kafka brokers
$conf->set('metadata.broker.list', '127.0.0.1:9092');
 
//设置使用手动提交offset
$conf->set('enable.auto.commit', 'false');
 
$topicConf = new RdKafka\TopicConf();
 
// Set where to start consuming messages when there is no initial offset in
// offset store or the desired offset is out of range.
// 'smallest': start from the beginning
$topicConf->set('auto.offset.reset', 'smallest');
 
// Set the configuration to use for subscribed/assigned topics
$conf->setDefaultTopicConf($topicConf);
 
$consumer = new RdKafka\KafkaConsumer($conf);
 
// Subscribe to topic 'test'
$consumer->subscribe(['test']);
 
while (true) {
    $message = $consumer->consume(120*1000);
    switch ($message->err) {
        case RD_KAFKA_RESP_ERR_NO_ERROR:
            var_dump($message);
            //消费完成后手动提交offset
            //$consumer->commit($message);     
            break;
        case RD_KAFKA_RESP_ERR__PARTITION_EOF:
            echo "No more messages; will wait for more\n";
            break;
        case RD_KAFKA_RESP_ERR__TIMED_OUT:
            echo "Timed out\n";
            break;
        default:
            throw new \Exception($message->errstr(), $message->err);
            break;
    }
}
 
————————————————
版权声明：本文为CSDN博主「青季」的原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接及本声明。
原文链接：https://blog.csdn.net/skypeng57/article/details/87715268