Event streaming database

I stumbled across Kafka in the search for a scalable messaging queue to parse some syslog output. Initially i was looking at RabbitMQ, ActiveMQ and ZeroMq to implement a solution for my issue. Some more low tech answers were also considered like simply running a process to grep a file or query in some other fashion but this article is more to talk about what Kafka is and how it works.

So at a very high level Kafka is a distributed log aggregator. This can be talked about in marketing terms as an event streaming platform but they're oen and the same for my usecase.

Kafka has at its heart a set of servers which can be clustered


By Tony Lokko