Cloud infrastructure as code

Build the cloud foundation in Terraform, to a high standard and designed to be configurable, so the platform can provision clusters of different profiles (front-facing, data-oriented, developer-oriented) from the same well-factored code. Treat infrastructure as code as software: small, composable modules with the versioning, review, and testing that make them reliable and reusable. The desired state lives in Git, the platform reconciles to it through GitOps, and drift is detected rather than discovered.

Data platform engineering on Kubernetes

Build and operate the infrastructure that runs the data platform: a lakehouse on Apache Iceberg with a Polaris catalog and Trino, event streaming on Kafka, orchestration with Airflow, and managed databases such as CloudNativePG, all on object storage (ADLS Gen2). Your focus is on the platform beneath these systems: deploying, securing, scaling, and upgradi...