Kafka on the Network - Wireshark Analysis

 This post follows on from my earlier Kafka Basics and Demo blog. This time we take a look at the packets. How does a Kafka producer send a message to a topic? How on earth does a Kafka consumer know that there is a message waiting to be fetched?

In this video, we look at the Kafka protocol basics with Wireshark. We learn how producers and consumers communicate with nodes and, importantly, how we find the packets that match errors in the Kafka log.