Hello Kafkateers!

In order to do our part to help flatten the curve of the spread of COVID-19, we are moving all of our meetups online for the time being. Please find the details to join this fun and informative meetup below.

-----

Agenda:
6:00pm-6:10pm Online Networking (feel free to BYOB!!)

6:10pm-7:10pm: Kafka Streams: Revisiting the Decisions of the Past (How I could have made it better), Jason Bell, Kafka DevOps Engineer @ Digitalis.io

7:10pm-7:30pm: Q&A

Joining our slack space is not instant, so ensure that you are in, in time for the event, follow the steps within this link before the day of the event if you can! https://launchpass.com/confluentcommunity

Find information about upcoming meetups and tons of content from past Kafka Meetups all over the world: cnfl.io/meetup-hub

-----
Speaker:
Jason Bell, Kafka DevOps Engineer @ Digitalis.io

Title:

Kafka Streams: Revisiting the Decisions of the Past (How I could have made it better)

Abstract:

One day a client asked the question, 'Can we stream 12TB of data a day?', leading on to a journey of discovery, learning, frustration and ultimately joy. Looking back, what could have been done differently? The Streaming API and the advent of KSQL and ksqlDB has made me think about the end-to-end process of this intensive job.

In this talk I will cover the original specification of the project and consider the questions asked then, and what I would ask now. From there I'll propose a new pipeline for the original data and highlight the gotchas along the way. Ultimately this is a talk on how to dig in deep with the data and ask the right questions when designing heavy duty Kafka pipelines, especially when the data is not as neat as you'd like it.

Bio:

Jason Bell is a Kafka Devops Engineer for Digitalis, he is also author of the Wiley published book, "Machine Learning: Hands on for Developers and Technical Professionals", which is now in its second edition. You can follow him (at your own peril) on Twitter: @jasonbelldata

Online Meetup Etiquette:
•Please unmute yourself when you have a question.
•Please hold your questions until the end of the presentation or use the zoomchat!
•Please arrive on time as zoom meetings can become locked for many reasons.