Exciting opportunity with a leading regional logistics and supply chain group — building out their next-generation data platform to power AI and analytics at scale.
Role - Architect and build scalable data pipelines using Apache Spark, Kafka, and Airflow
- Design and manage cloud-based data lakes and warehouses (Snowflake, BigQuery, or Databricks)
- Implement data quality frameworks, governance policies and monitoring
- Collaborate with data scientists and analysts to ensure data is readily available for modelling
- Drive adoption of best practices in data modelling, CI/CD and infrastructure-as-code
Requirements - 5+ years of data engineering experience with at least 2 years on big data technologies
- Strong command of SQL and Python; experience with dbt, Spark or Flink
- Hands-on cloud experience: AWS, GCP or Azure data services
- Familiarity with streaming data architectures (Kafka, Kinesis) ...