Responsibilities

• Architect and implement a centralized data platform on Databricks
• Design data models and unified schemas across multiple product lines
• Implement multi-catalog governance strategy using Unity Catalog
• Optimize Delta Lake performance through Z-ordering, compaction, and liquid clustering
• Build declarative ETL pipeline frameworks using Delta Live Tables
• Integrate third-party data sources like ERP systems and external providers
• Implement cost monitoring, data quality frameworks, and self-service patterns

Requirements

• 5-8 years in data engineering or data platform roles
• 3+ years hands-on Databricks experience
• Expertise in Unity Catalog, Delta Lake, and Delta Live Tables
• Proficiency in PySpark and Databricks SQL
• Experience with AWS (S3, IAM, VPC)
• Infrastructure-as-code experience, preferably with Terraform
• Proven track reco...