Overview
Azure Data Engineer role with the opportunity to work on data pipelines, quality improvements, security and compliance activities in a hybrid Madrid environment.
Responsibilities
- Build and maintain data pipelines from core banking and external sources
- Implement data quality improvements for monitoring and alerting
- Data security and compliance activities as required
- Design and implement Azure Data Factory; manage Azure Data Lake storage (ADLS)
- Collaborate with Innovation teams to operationalize models and rules
Technologies
- Azure Databricks
- Python
- Scala
- PySpark
- Azure Data Factory
Qualifications
- Years of experience: minimum 5 years in a similar role
- Hands-on experience building ETL data pipelines using Python, Scala and PySpark; ability to optimize data models
- Fluent English
Location ...