A custom Flume sink that integrates flume and RabbitMQ.
The sink sends each Flume event received to a RabbitMQ queue. The queue name is determined by a parameter in the event's metadata map. The RabbitMQ's host, user and password are all configurable as well.
This project uses gradle as its build tool.
Steps:
- Clone the repository.
- Run "gradle build" from the project's root dir.
- Copy rabbit-sink-{ver}.jar from build/libs directory to the flume master and node classpath dir.
- Add com.kenshoo.flume.rabbitmq.RabbitMqSink to flume-site.xml plugins section on the master node.
- (Re)start the master node and verify that RabbitSink is part of the plugins list.
- On the collector-sink's configuration, add rabbitsink('host','user','pass').
This code is released under the Apache Public License 2.0.