Introduction to ksqlDB

A presentation at Software Circus / Amsterdam Kafka Meetup in in Amsterdam, Netherlands by Robin Moffatt

You’ve got streams of data that you want to process and store? You’ve got events from which you’d like to derive state or build aggregates? And you want to do all of this in a scalable and fault-tolerant manner? It’s just as well that Kafka and ksqlDB exist!

This talk will be built around a live demonstration of the concepts and capabilities of ksqlDB. We’ll see how you can apply transformations to a stream of events from one Kafka topic to another. We’ll use ksqlDB connectors to bring in data from other systems and use this to join and enrich streams—and we’ll serve the results up directly to an application, without even needing an external data store.

Attendees will learn:

  • How to process streams of events
  • The semantics of streams and tables, and of push and pull queries
  • How to use the ksqlDB API to get state directly from the materialised store
  • What makes ksqlDB elastically scalable and fault-tolerant.

Video

Resources

The following resources were mentioned during the presentation or are useful additional information.

Buzz and feedback

Here’s what was said about this presentation on social media.