SkillData EngineerSoftware Engineer (Backend)
Library · tool
Kafka and event streaming
Move events between systems in real time with Kafka, and understand partitions, consumer groups and delivery guarantees.
Kafka and streaming appeared in 32% of the Software Engineer and 30% of the Data Engineer postings we read. Managed services such as Amazon Kinesis, Google Pub/Sub and Azure Event Hubs follow the same ideas.
The examples run against a real single-node Kafka 4 broker on a laptop, replaying one hour of New York taxi trips as events.
Beginner lessons for Kafka and event streaming are being written.