Job Description
A client of Insight Global is seeking a Senior Data Engineer to support a high-impact Connectivity project, focused on building and maintaining scalable data pipelines that ingest, clean, transform, and integrate both structured and real-time streaming data. This role partners closely with Data Scientists to deliver production-ready datasets that power advanced analytics and machine learning models.

Key Responsibilities
Design, build, and maintain robust data pipelines for both batch and real-time data ingestion, including structured sources and raw streaming data from Kafka
Clean, transform, and standardize incoming data to ensure high-quality, analytics-ready datasets
Integrate curated data pipelines with machine learning models developed by Data Science teams
Develop and optimize workflows using Apache Airflow for scheduling and orchestration
Build cloud-native data solutions leveraging AWS, including S3, Kubernetes, and related services