We are seeking a highly skilled Senior Data Engineer to join our Data Engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and enabling advanced analytics and machine learning use cases. This role requires strong expertise in big data technologies, data processing frameworks, and feature engineering to support ML models in a production environment.

Key Responsibilities

• Gather and analyze business and technical requirements for data solutions
• Perform Exploratory Data Analysis (EDA) to understand data patterns and quality
• Design, build, and maintain scalable and high-performance data pipelines
• Ingest structured and unstructured data from multiple sources
• Transform and process large datasets using PySpark and Python
• Implement feature engineering techniques for machine learning models
• Optimize Spark jobs for performance and c...