Track host
About the track
Data technologies and SaaS platforms are evolving fast to meet the challenge of sophisticated use cases. They are changing the landscape of the modern data stack, from OLTP, data lakehouse to analytical systems, and empowering a new ecosystem in data engineering where batch and realtime systems are converging. But what should you choose? Can we do more with less? Come to this track to learn some fundamental, powerful yet versatile building blocks and their core engineering principles that you can leverage to build a simple yet efficient and scalable data architecture.
The day in the host's words
Sessions in this track
Tuesday 13 June. 6 sessions per track, chosen and introduced by the Track Host.
10:35 Salon E Session Streaming Laying the Foundations for a Kappa Architecture - The Yellow Brick Road Sherin Thomas Staff Software Engineer @Chime In the ever changing landscape of big data, focus is slowly moving away from batch and towards realtime analytics. Data Science workflows are evolving to adapt to this changing landscape. 11:50 Salon E Session Stream Processing Streaming from Apache Iceberg - Building Low-Latency and Cost-Effective Data Pipelines Steven Wu Software Engineer @Apple and Apache Iceberg PMC Apache Flink is a very popular stream processing engine featuring sophisticated state management, even-time semantics, exactly-once state consistency. For low latency processing, Flink jobs typically consume data from streaming sources like Apache Kafka. 13:40 Salon D Session Serverless The Rise of the Serverless Data Architectures Gwen Shapira Founder @Nile, PMC Member @Kafka For a while, it looked like Serverless was just a convenient way to run stateless functions in the cloud. But in the last year we’ve seen the rapid rise in serverless data stores. 14:55 Salon E Session Data Architecture Building a Large Scale Real-Time Ad Events Processing System Chao Chu Software Engineer @DoorDash Two years ago, we embarked on building DoorDash's ad platform from the ground up. Today, our platform handles over 2 trillion events every day and our advertising business has experienced significant growth in recent years, becoming a key area of focus for the company. 16:10 Salon E Session Architecture Enabling Remote Query Execution Through DuckDB Extensions Stephanie Wang Founding Engineer @MotherDuck DuckDB is a high-performance, embeddable analytical database system that has gained massive popularity in the last few years. 17:25 Carroll Gardens Unconference Unconference: Modern Data Architecture & Engineering Ben Linders Independent Consultant in Agile, Lean, Quality and Continuous Improvement What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.QCon New York 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.