flume默認提供了以下channel:
Memory Channel:
a1.channels = c1
a1.channels.c1.type = memory
a1.channels.c1.capacity = 10000
a1.channels.c1.transactionCapacity = 10000
a1.channels.c1.byteCapacityBufferPercentage = 20
a1.channels.c1.byteCapacity = 800000
JDBC Channel:
a1.channels = c1
a1.channels.c1.type = jdbc
Kafka Channel:
a1.channels.channel1.type = org.apache.flume.channel.kafka.KafkaChannel
a1.channels.channel1.kafka.bootstrap.servers = kafka-1:9092,kafka-2:9092,kafka-3:9092
a1.channels.channel1.kafka.topic = channel1
a1.channels.channel1.kafka.consumer.group.id = flume-consumer
File Channel:
a1.channels = c1
a1.channels.c1.type = file
a1.channels.c1.checkpointDir = /mnt/flume/checkpoint
a1.channels.c1.dataDirs = /mnt/flume/data
Spillable Memory Channel
a1.channels = c1
a1.channels.c1.type = SPILLABLEMEMORY
a1.channels.c1.memoryCapacity = 10000
a1.channels.c1.overflowCapacity = 1000000
a1.channels.c1.byteCapacity = 800000
a1.channels.c1.checkpointDir = /mnt/flume/checkpoint
a1.channels.c1.dataDirs = /mnt/flume/data
Custom Channel
自定義channel要繼承Channel接口
flume二:flume Channel介紹
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章
flume三:flume Channel selector介紹
琳琳庚主LoveU
2020-06-14 05:31:13
Avro Source配置詳解
監聽Avro端口和從外部Avro端接收事件流。 當在另一個(上一個)Flume agent搭配內置Avro sink,它可以創建分層集合拓撲。 以下
琳琳庚主LoveU
2020-06-14 05:31:13
flume六:Event Serializers介紹
琳琳庚主LoveU
2020-06-14 05:31:13
flume七:Flume Interceptors介紹
琳琳庚主LoveU
2020-02-25 07:26:08
flume四:flume sink介紹
琳琳庚主LoveU
2020-02-25 07:26:08
flume三:flume Channel selector介紹
琳琳庚主LoveU
2020-06-14 05:31:13
Avro Source配置詳解
監聽Avro端口和從外部Avro端接收事件流。 當在另一個(上一個)Flume agent搭配內置Avro sink,它可以創建分層集合拓撲。 以下
琳琳庚主LoveU
2020-06-14 05:31:13
flume六:Event Serializers介紹
琳琳庚主LoveU
2020-06-14 05:31:13
flume五:flume Processors介紹
琳琳庚主LoveU
2020-02-25 07:26:08
flume七:Flume Interceptors介紹
琳琳庚主LoveU
2020-02-25 07:26:08