As an Azure Data Engineer, you will:
- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Build and optimize large-scale data processing solutions using PySpark and Databricks.
- Develop robust ETL/ELT workflows using Python for data extraction, transformation, and loading.
- Implement and maintain CI/CD pipelines in Azure DevOps to automate deployment and testing of data solutions.
- Collaborate with business stakeholders, data architects, and engineering teams to translate data requirements into scalable solutions.