The missions are to:

• Implement solutions using PySpark
• Design, build, and maintain efficient, reusable, and reliable code,
• Ensure the best possible performance, quality, and responsiveness
• Identify bottlenecks and bugs, and devise solutions to mitigate and address those issues,
• Help maintain code quality and organization.

Qualifications:

• Proven expertise in Hadoop, Spark, Scala, and PySpark.
• Significant professional experience in the Big Data domain, with in-depth expertise in the Hadoop, Spark, Scala, and PySpark ecosystem.
• Excellent command of the Java programming language, with advanced development and maintenance skills.
• Strong Scala or PySpark development skills, with experience in rewriting Java components in Scala or PySpark.
• Good knowledge of data engineering, systems engineering, software engineering, and Big Data architecture principles.