Job Description:
Databricks Architect
Job Location: Hyderabad / Bangalore / Chennai / Kolkata / Noida/ Gurgaon / Pune / Indore / Mumbai
Architect and implement Databricks-based data platforms and Lakehouse solutions on Azure.Data modelling (medallion architecture — Bronze/Silver/Gold), Python / SQL (advanced)Design scalable ETL/ELT pipelines using Spark, Delta Lake, and DBT; enforce schema, compaction, and partition strategies.Define and implement data governance, access control, and lineage with Unity Catalog and Azure Purview.Optimize Spark jobs for performance and cost; implement cluster sizing, autoscaling, and job scheduling.Build robust ingestion patterns (APIs, streaming, batch), incremental/CDC strategies, and idempotent pipelines.Establish CI/CD, IaC (Terraform), and monitoring/observability for Databricks workspaces and pipelines.Mentor engineering teams on best practices...