Skip to contentRU
Talk

DataOps Under the Microscope: CRD and Kubernetes Operators for the ETL Test Tube Lifecycle

In RussianComplexity -For practicing engineers
Presentation pdf

How the T-Bank team migrated DataOps to Kubernetes and didn't go crazy. I'll tell you how we designed and implemented infrastructure for managing the lifecycle of ETL tasks using Kubernetes operators, automated DAG delivery and integrated it into the existing DataOps. I'll analyse what happened, where we made mistakes, and what you absolutely shouldn't do.

Speakers

Invited experts

  • Other talks on «Architecture of Data Platforms»

    Schedule