Author: Jun Rao

Project Metamorphosis Month 3: Infinite Storage in Confluent Cloud for Apache Kafka

Jul 1, 2020

This is the third month of Project Metamorphosis, where we discuss new features in Confluent’s offerings that bring together event streams and the best characteristics of modern cloud data systems.


Apache Kafka Supports 200K Partitions Per Cluster

Nov 8, 2018

In Kafka, a topic can have multiple partitions to which records are distributed. Partitions are the unit of parallelism. In general, more partitions leads to higher throughput. However, there are


Kafka Summit NYC Systems Track: What to Expect

Apr 25, 2017

In our previous post on the Streaming Pipelines track, we highlighted some of the sessions not to be missed at Kafka Summit NYC. As a follow on to that, let’s


The Value of Apache Kafka in Big Data Ecosystem

Jun 16, 2015

This is a repost of a recent article that I wrote for ODBMS. In the last few years, there has been significant growth in the adoption of Apache Kafka. Current


ApacheCon 2015

Apr 28, 2015

I was at ApacheCon 2015 in Austin, Texas a couple of weeks ago. The following is a short summary of some of the trends that I observed at the conference.


Apache Kafka 0.8.2.1 release

Mar 13, 2015

The Apache Kafka community just announced the 0.8.2.1 release. This is a a bug fix release and fixes 4 critical issues reported in the 0.8.2.0 release (the full list of


How to Choose the Number of Topics/Partitions in a Kafka Cluster?

Mar 12, 2015

Note For the latest, check out the blog posts Apache Kafka® Made Simple: A First Glimpse of a Kafka Without ZooKeeper and Apache Kafka Supports 200K Partitions Per Cluster.