flume配置: #DBFileDBFile.sources = sources1 DBFile.sinks = sinks1 DBFile.channels = channels1 # DBFile-DB-Source DBFile.sources.sources1.type ...
flume配置:
#DBFileDBFile.sources = sources1 DBFile.sinks = sinks1 DBFile.channels = channels1 # DBFile-DB-Source DBFile.sources.sources1.type = spooldirDBFile.sources.sources1.spoolDir =/var/log/apache/flumeSpool//dbDBFile.sources.sources1.inputCharset=utf-8 # DBFile-Sink DBFile.sinks.sinks1.type = org.apache.flume.sink.kafka.KafkaSink DBFile.sinks.sinks1.topic = DBFileDBFile.sinks.sinks1.brokerList = hdp01:6667,hdp02:6667,hdp07:6667DBFile.sinks.sinks1.requiredAcks = 1 DBFile.sinks.sinks1.batchSize = 2000 # DBFile-ChannelDBFile.channels.channels1.type = memoryDBFile.channels.channels1.capacity = 10000DBFile.channels.channels1.transactionCapacity = 1000# DBFile-Source And Sink to the channelDBFile.sources.sources1.channels = channels1DBFile.sinks.sinks1.channel = channels1
海外公司注册、海外银行开户、跨境平台代入驻、VAT、EPR等知识和在线办理:https://www.xlkjsw.com
原标题:flume:spooldir采集日志,kafka输出的配置问题
关键词:Kafka
*特别声明:以上内容来自于网络收集,著作权属原作者所有,如有侵权,请联系我们:
admin#shaoqun.com
(#换成@)。