Apache Kafka is commonly used to centralise log and event ingest from across an organisation. With its built-in stream processing capabilities, it's possible to easily process this data in real time.

In this talk we'll see how to use the open-source Apache Kafka and KSQL projects to ingest syslog data into Apache Kafka, and then process it with KSQL. KSQL provides a SQL-like language for expressing stream transformations, making it easy for developers to develop powerful stream processing applications and pipelines. As well as exploring the power of KSQL, we'll see a simple example of a microservice to drive alerting based on events from Kafka.