Meetup

Data engineering meetup

Join us for an engaging meetup: Data Builders’ Evening: Architecture, Engineering & Beyond.

Date

September 16th, 2025

18:00 – 21:30

Location

diconium GmbH Berlin Office
Skalitzer Straße 126
10999 Berlin

Drinks & Food

A few drinks and some
Snacks are available
free of charge.

Dear data-loving community, we can’t wait to present to you our new Meetup event: This time, it will be a collaboration with RisingWave, a platform for real-time streaming data management and analysis. Yingjun Wu, Founder and CEO at RisingWave Labs, will share his experience in a techy talk, as well as Behnaz Derakhshani, who works as a Specialist Data Engineer at Diconium’s data department. Additionally, we’re going to welcome external guest speaker Erik Schmiegelow, CEO at Hivemind Technologies. Exciting line-up, right? 😀

Achieving Sub-100-ms Real-Time Stream Processing with an S3-Native Architecture

Stream processing systems have traditionally relied on local storage engines such as RocksDB to achieve low latency. While effective in single-node setups, this model doesn’t scale well in the cloud, where elasticity and separation of compute and storage are essential. In this talk, we’ll explore how RisingWave rethinks the architecture by building directly on top of S3 while still delivering sub-100 ms latency. At the core is Hummock, a log-structured state engine designed for object storage. Hummock organizes state into a three-tier hierarchy: in-memory cache for the hottest keys, disk cache managed by Foyer for warm data, and S3 as the persistent cold tier. This approach ensures queries never directly hit S3, avoiding its variable performance. We’ll also examine how remote compaction offloads heavy maintenance tasks from query nodes, eliminating interference between user queries and background operations. Combined with fine-grained caching policies and eviction strategies, this architecture enables both consistent query performance and cloud-native elasticity. Attendees will walk away with a deeper understanding of how to design streaming systems that balance durability, scalability, and low latency in an S3-based environment.

Yingjun Wu

Founder & CEO at RisingWave

Behnaz Derakhshani

Behnaz Derakhshani

specialist data engineer at Diconium

diconium logo

From Raw Data to Trusted Assets: A Practical Walkthrough with AWS services and Collibra

Expect a hands-on journey of Behnaz showing how modern data lake tools and governance platforms connect the dots, making your data discoverable, governed, and productized for real-world use.

Effective Agentic GenAI in Data Streaming

Successful genAI projects strike the balance between impact, accuracy, and cost. In this talk, Erik will cover how to create agentic data applications effectively, choosing when and how to integrate them in data streams and keep response quality issues and costs in check.

Erik Schmiegelow

CEO at Hivemind Technologies

Agenda

18:00

Event admission

18:30

Welcome & Introduction

18:35

Achieving Sub-100-ms Real-Time Stream Processing with an S3-Native Architecture

Yingjun Wu

19:15

From Raw Data to Trusted Assets: A Practical Walkthrough with AWS services and Collibra

Behnaz Derakhshani

19:45

Effective Agentic GenAI in Data Streaming

Erik Schmiegelow

20:15

Snacks, Drinks & Networking

21:30

End

You want to give a talk at our meetup?

We are open to external speakers. So, if you’re interested in giving a short talk on a Data Engineering topic or have additional input on possible topics, feel free to reach out and leave us a message here:

What to expect:

Hosts

Peer Schwirtz

Peer Schwirtz

Director data architecture & data engineering

Prateek Narula

Prateek Narula

Director cloud engineering

Jens Wriske

Jens Wriske

Senior cloud architect

Get your free ticket now

Please join our meetup group to attend the event.

At the event, sound, image and video recordings are created and published for documentation purposes as well as for the presentation of the event in publicly accessible media, on websites and blogs and for presentation on social media. By participating the event, the participant implicitly consents to the aforementioned photo and/or video recordings. Find more information on data protection here.


Recap: data engineering meetup July 2025

Our latest Data Engineering Meetup took place on July 22nd in Berlin. Despite the not very summery weather, a diverse and large group of data-loving people came together to enjoy Aleksandr Kudriavtcev’s talk featuring cute cats, candid opinions, and plenty of technical depth.

And the event didn’t end with the talk: for the first time, we also included an interactive part using Mentimeter, which sparked a wide range of insights and showcased the diversity of our data community. Conversations continued well into the evening, accompanied by food from the grillmaster, until it got dark outside.

We can’t wait to host the next one – stay tuned!


Recap: data engineering meetup May 2025

Lessons from the Cloud: Building a Scalable, Decentralized Data Platform with Snowflake, dbt & S3

Business Intelligence in practice: Dagster & DBT


Recap: data engineering meetup March 2025

On March 13th 2025, we have been focussing on scaling analytics with dbt and simplifying Kubernetes job execution. Thanks to everyone who attended our event last Thursday as part of the audience and by connecting with us and like-minded people over a drink or a pretzel. We were impressed by the specific questions that came up during and after the talks!

Topics

Scaling Analytics with dbt: From Implementation to Impact – with Ceren Gündoğdu

Kube API: Simplifying Kubernetes Job Execution – with Ajit Gosavi


Recap: data engineering meetup December 2024

Thank you to everyone who joined us for our latest data engineering meetup! It was an incredible evening filled with insightful discussions, innovative ideas, and valuable networking.

A huge shoutout to our speakers, whose expertise and engaging presentation truly enlightened us on their real life use cases in the world of data engineering. We are so grateful for your contribution and the knowledge you shared with our community. We also want to extend our thanks to all the attendees who brought their energy, questions, and enthusiasm to the event. Your active participation is what makes our meetups so special.

Rewatch the presentations here:

Behnaz Derakhshani

The Day It All Went Down: A True Story of Challenges and Lessons from our Snowplow Pipeline Outage

Aditya Kadiwal, Reza Yazdani

Inside a real-world databricks Project: Setup, implementation, customer wins, and lessons learned


Host

This meetup is hosted by diconium.

LinkedIn

Please follow the applydata LinkedIn page.

data insights

Back to top