Job Description We seek a DevOps Engineer to play a pivotal role in maturing our data platform and developer experience. You will be responsible for evolving our DevOps platform, processes and systems with the ultimate aim of enhancing developer velocity and practices, improving code and data quality, and maintaining a well‑managed data platform.
Key Responsibilities - Databricks Asset Bundles (DABs): Enhance our DABs processes to improve developer experience and velocity.
- CI/CD Pipeline Development: Build end‑to‑end automation in Azure DevOps to test and promote code across our environments (covering ADF, ADB and PowerBI).
- Infrastructure as Code (IaC): Automate the provisioning of Databricks workspaces, clusters and projects using Terraform or relevant templates.
- Governance: Mature and manage security policies and access controls.
- ADF Management: Manage our ADF resources, optimizing for reliability and cost.
...