Position Overview
Job Summary
We are looking for 4-5 years of experience as a Data Engineer with strong expertise in Spark (PySpark), SQL, and data pipeline architecture. The role involves designing, building, and optimizing scalable data workflows to support analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and enjoys building reliable data solutions while collaborating with cross-functional teams.
Job Requirements
Strong expertise in Spark (PySpark) and SQL
Experience in designing and building data pipelines
Understanding of AI concepts
Good communication and collaboration skills
Experience with streaming tools like Kafka/Kinesis
Proficiency in Python, with exposure to Databricks or Azure
Familiarity with Airflow/NiFi, Debezium, HTAP systems, or logistics domain is a plus
Job Responsibilities
Design and architect scalable data pipelines for batch and real-time processing.
Develop and optimize data solutions using Spark (...