flume采集最简demo

1、安装jdk1.8以上

2、解压flume

tar -zxvf  apache-flume-1.9.0-bin.tar.gz  cd  apache-flume-1.9.0-bin/conf cp  flume-env.sh.template  flume-env.sh vim conf/flume-env.sh JAVA_HOME=/soft/jdk1.8.0_101

3、验证是否成功

/bin/flume-ng version Flume 1.9.0 Source code repository: https://git-wip-us.apache.org/repos/asf/flume.git

4、案例
创建demo.conf

touch demo.conf

写入

# example.conf: A single-node Flume configuration# Name the components on this agent a1.sources = r1 a1.sinks = k1 a1.channels = c1# Describe/configure the source a1.sources.r1.type = netcat a1.sources.r1.bind = localhost a1.sources.r1.port = 44444# Describe the sink a1.sinks.k1.type = logger# Use a channel which buffers events in memory a1.channels.c1.type = memory a1.channels.c1.capacity = 1000 a1.channels.c1.transactionCapacity = 100# Bind the source and sink to the channel a1.sources.r1.channels = c1 a1.sinks.k1.channel = c1

5、启动

bin/flume-ng agent --conf conf --conf-file conf/demo.conf --name a1 -Dflume.root.logger=INFO,console

6、写点测试数据

telnet localhost 44444

如果telnet命令不存在

yum install -y telnet

 

7、更多案例

http://www.aboutyun.com/thread-8917-1-1.html

总结

以上是生活随笔为你收集整理的flume采集最简demo的全部内容，希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错，欢迎将生活随笔推荐给好友。