Position Description:

We are seeking a highly skilled Senior Azure Data Engineer to join our growing data team. The role involves designing, developing, and operationalizing large-scale data processing systems on the Azure cloud platform. The ideal candidate will have strong expertise in Azure Databricks, Azure Data Lake, PySpark, and Python, with a proven ability to build efficient, scalable, and reliable data pipelines.

Your future duties and responsibilities:

• Design and maintain scalable data pipelines for ingesting, processing, and transforming structured and unstructured data.
• Develop and optimize Spark jobs using PySpark and Spark SQL within Azure Databricks.
• Implement Azure Data Lake Storage (Gen2) solutions following medallion architecture (Bronze, Silver, Gold layers).
• Collaborate with stakeholders (data architects, analysts, business teams) to translate requirements into technical solutions.
• Ensure dat...