Position Overview
Transform data management as an AI/ML Data Engineer specializing in Databricks in East Toronto. Design and enhance machine learning platforms, leading impactful data initiatives.
We are looking for a Databricks Engineer to take charge of designing scalable data pipelines and machine learning workflows. This senior role is key in shaping production AI systems and optimizing cluster performance. Your deep knowledge of Databricks, Spark, and AI will allow you to collaborate with data scientists to elevate data governance practices.
Key Responsibilities:
β’ Design and implement scalable ETL pipelines on Databricks
β’ Deploy ML models using MLflow for effective insights
β’ Build MLOps pipelines for managing model lifecycle
β’ Integrate analytics with leading BI tools
β’ Manage data quality and compliance requirements
Requirements:
β’ 5+ years of experience with Databricks & Apache Spark
β’ Strong skills in Python & Py...