Big Data Developer - Spark Scala
We are seeking a highly skilled Big Data Developer specializing in Spark and Scala to join a project with one of our prominent wealth management clients. The role involves designing, developing, and maintaining data pipelines while collaborating closely with the client’s IT and business stakeholders.
Responsibilities
- Designing and developing ETL/data transformation processes.
- Implementing and maintaining Spark-based pipelines and supporting data integration initiatives.
- Analyzing and troubleshooting data-related issues to ensure data quality and performance across the platform.
- Leveraging AI-assisted development tools and exploring AI-driven approaches to improve data engineering, automation, and analytics processes (considered a plus).
Qualifications
- 3+ years of experience in data engineering and programming.
- Strong SQL skills (ANSI SQL, Hive SQL, Spark ...