Ephemeral Execution Is the Future of Computing, but What About the Data?

Ephemeral processes like containers are increasingly being used to build and run applications because of their isolation, portability, and efficiency. But they're often bogged down by data gravity when handling data-intensive applications. If a process is executing only for a short time in isolation, how can it consume and produce data from and to a variety of locations, beyond the bounds of just databases?

In this talk, we will use Tekton as a case study to explore challenges of data gravity in ephemeral execution. Tekton is an orchestration engine for CI/CD that executes arbitrary user-supplied workloads as containers on Kubernetes. Tekton workloads need to securely consume data (such as source code) and produce data (such as binary artifacts), while avoiding limitations of the underlying architecture. To address these challenges, Tekton is exploring approaches including clean container injection mechanisms for backing immutable artifacts, and a secure server interface between orchestrating controllers and user-specified workloads for communicating trusted metadata.

Learn how to effectively use ephemeral processes to build and run data-intensive applications.

 


Speaker

Jerop Kipruto

Senior Software Engineer @Google

Jerop Kipruto is a Senior Software Engineer at Google and a maintainer of the Tekton project, where she works on making it easier and fun for developers to build and ship cloud native applications. She holds a B.Sc. in Electrical Engineering and Computer Science from Massachusetts Institute of Technology. Jerop is also a frequent speaker at industry conferences, including the Linux Foundation Member Summit, Continuous Delivery Conference, Open Source Summit, and Google DevFest. Outside of work, she enjoys staying active and reconnecting with her Kenyan roots through running.

Read more

Speaker

Christie Warwick

Software Engineer @Google

Christie Warwick (Wilson) (she/her) is a software engineer with a passion for building quality software and having fun doing it. During her career she has worked on everything from currency exchange to AAA games.

Currently, she builds continuous delivery tools at Google, where she is proud to have co-created Tekton: an open-source continuous delivery platform built on Kubernetes. She is the author of Grokking Continuous Delivery and a speaker at Kubecon, InfoQ, OSCON and more. In her spare time she influences company culture through cat pictures.

Read more

Date

Thursday Jun 15 / 10:35AM EDT ( 50 minutes )

Location

Salon A-C

Topics

Architecture Cloud Native Continuous Delivery

Share

From the same track

Session Edge Computing

Living on the Edge

Thursday Jun 15 / 11:50AM EDT

Edge computing is not a new concept, but in the past few years we're seeing powerful tools made more easily available at the edge from providers such as Cloudflare, Netlify, and Vercel. In this session, we'll look at:

Speaker image - Erica Pisani
Erica Pisani

Sr. Software Engineer @Netlify

Session Local First

Offline and Thriving: Building Resilient Applications With Local-first Techniques

Thursday Jun 15 / 02:55PM EDT

Discover the art of building offline-first applications that function even in the face of unreliable or nonexistent network connections.

Speaker image - Carl Sverre
Carl Sverre

Entrepreneur in Residence @Amplify Partners

Session Cloud

Developing Above the Cloud

Thursday Jun 15 / 01:40PM EDT

Cloud development is marred with complexity. In addition to the domain knowledge for their business, a development team must also have significant expertise in cloud hosting and deployment, only some of which can be outsourced to a hosting provider or platform team.

Speaker image - Paul Biggar
Paul Biggar

Founder / CEO @Darklang

Session Cloud

From Smoothie Architecture to Layer Cake with Durable Execution

Thursday Jun 15 / 04:10PM EDT

Traditional cloud applications tend to mix up several core concerns, such as business logic, state management, and handling of failures, into a ‘Smoothie’ architecture, which greatly impedes their development and evolution.

Speaker image - Sergey Bykov
Sergey Bykov

SDE @Temporal Technologies