你的位置:首页 > 软件开发 > 数据库 > flume:spooldir采集日志,kafka输出的配置问题

flume:spooldir采集日志,kafka输出的配置问题

发布时间:2016-12-03 11:01:19
flume配置: #DBFileDBFile.sources = sources1 DBFile.sinks = sinks1 DBFile.channels = channels1 # DBFile-DB-Source DBFile.sources.sources1.type ...

flume配置:

#DBFileDBFile.sources = sources1 DBFile.sinks = sinks1 DBFile.channels = channels1  # DBFile-DB-Source DBFile.sources.sources1.type = spooldirDBFile.sources.sources1.spoolDir =/var/log/apache/flumeSpool//dbDBFile.sources.sources1.inputCharset=utf-8 # DBFile-Sink DBFile.sinks.sinks1.type = org.apache.flume.sink.kafka.KafkaSink DBFile.sinks.sinks1.topic = DBFileDBFile.sinks.sinks1.brokerList = hdp01:6667,hdp02:6667,hdp07:6667DBFile.sinks.sinks1.requiredAcks = 1 DBFile.sinks.sinks1.batchSize = 2000  # DBFile-ChannelDBFile.channels.channels1.type = memoryDBFile.channels.channels1.capacity = 10000DBFile.channels.channels1.transactionCapacity = 1000# DBFile-Source And Sink to the channelDBFile.sources.sources1.channels = channels1DBFile.sinks.sinks1.channel = channels1

 

海外公司注册、海外银行开户、跨境平台代入驻、VAT、EPR等知识和在线办理:https://www.xlkjsw.com

原标题:flume:spooldir采集日志,kafka输出的配置问题

关键词:Kafka

*特别声明:以上内容来自于网络收集,著作权属原作者所有,如有侵权,请联系我们: admin#shaoqun.com (#换成@)。

可能感兴趣文章

我的浏览记录