Author: Martin Kleppmann

Should You Put Several Event Types in the Same Kafka Topic?
Jan 18, 2018

If you adopt a streaming platform such as Apache Kafka, one of the most important questions to answer is: what topics are you going to use? In particular, if you [...]

Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
Aug 1, 2015

One of the things I realised while doing research for my book is that contemporary software engineering still has a lot to learn from the 1970s. As we’re in such [...]

Using logs to build a solid data infrastructure (or: why dual writes are a bad idea)
May 29, 2015

This is an edited transcript of a talk I gave at the Craft Conference 2015. The video and slides are also available.

Bottled Water: Real-time integration of PostgreSQL and Kafka
Apr 23, 2015

Summary: Confluent is starting to explore the integration of databases with event streams. As part of the first step in this exploration, Martin Kleppmann has made a new open source [...]

Real-time full-text search with Luwak and Samza
Apr 13, 2015

This is an edited transcript of a talk given by Alan Woodward and Martin Kleppmann at FOSDEM 2015. Traditionally, search works like this: you have a large corpus of documents, [...]

Turning the database inside-out with Apache Samza
Mar 1, 2015

This is an edited and expanded transcript of a talk I gave at Strange Loop 2014. The video recording (embedded below) has been watched over 8,000 times. For those of [...]

Stream Processing, CEP, Event Sourcing, and Data Streaming Explained
Jan 29, 2015

Some people call it stream processing. Others call it event streaming, complex event processing (CEP), or CQRS event sourcing. Sometimes, such buzzwords are just smoke and mirrors, invented by companies [...]