Databricks Platform Engineer
Location: PAN India
Experience: 7+ Years
We are looking for an experienced Databricks Platform Engineer to design, build, and manage enterprise-scale Data & AI platforms on Azure Databricks. The ideal candidate will have strong expertise in Databricks administration, Delta Lake, Unity Catalog, Azure cloud services, and modern data engineering practices, along with experience building AI/RAG solutions.
Key Responsibilities:
Manage Azure Databricks workspaces, clusters, jobs, and governance using Unity Catalog.
Design and implement Delta Lake Medallion Architecture (Bronze, Silver, Gold).
Build and optimize data pipelines using Python, Py Spark, and SQL.
Configure and manage ADLS Gen2, Key Vault, Service Principals, and IAM.
Develop CI/CD pipelines using Azure Dev Ops or Git Hub Actions.
Deploy and manage Databricks workflows, DLT pipelines, and model-serving endpoints.
Build and support RAG (Retrieval-Augmented Generation) so...