Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Requirements Strong experience designing, developing, and maintaining complex data pipelines using Azure Data Factory and Azure Databricks. Hands-on experience building and optimizing large-scale data processing solutions using PySpark and Databricks. Experience collaborating with cross-functional teams to gather data requirements and deliver scalable data engineering solutions. Proficiency in implementing CI/CD pipelines using Azure DevOps for automated build, testing, integration, and deployment. Strong programming skills in Python with experience developing, testing, and maintaining ETL processes for data extraction, transformation, and loading. Experience monitoring, troubleshooting, and optimizing data pi...