America's Job Portal
Job Title: Data Engineer
Level: Senior Consultant
Experience: 3-6 Years
Location: Mumbai and Ahmedabad
Role Summary
The Data Engineer role focuses on the design, development, and maintenance of scalable,
reliable, and high-performance data platforms. The role requires strong hands-on expertise in
Python-based microservices, distributed data processing frameworks, and cloud-based big
data ecosystems, with a primary emphasis on building robust applications to process ETL
pipelines and production-grade data systems.
Key Responsibilities
Design, develop, and maintain scalable Python-based microservices for data ingestion and
processing
Build and optimize microservices to support end-to-end ETL pipelines for large-scale batch and
streaming data
Develop and manage distributed data processing workfl ows using Apache Spark and PySpark
Create, schedule, and monitor workfl ows using Apache Airfl ow
Design and deploy data...