The MDP Databricks Architect / Consultant / Developer designs, builds and operates modern analytics and data platforms using the Databricks Lakehouse Platform. The role enables organisations to deliver scalable, high-performance, governed data solutions across analytics, business intelligence (BI), data engineering, data science, and artificial intelligence/machine learning (AI/ML) workloads.
Key Responsibilities
- Design and implement modern data platforms using the Databricks Lakehouse Platform.
- Build ingestion and transformation pipelines using Databricks Workflows, Apache Spark (PySpark / Spark SQL) and Delta Lake, supporting batch, streaming and near real-time processing.
- Architect focus: Define and apply platform standards for data ingestion, modelling, data quality and governance; ensure alignment to cloud, security, identity and cost management requirements.
- Develop and optimise Databricks (Apache Spark) pipe...