Position Overview
Our Global Consultancy client is looking for an experienced Backend Engineer to design and build scalable, cloud-native data solutions on a permanent basis. You'll work across the full data lifecycle β from ingestion and transformation to warehousing and streaming β using a modern AWS and Python stack. If you enjoy solving hard data problems and collaborating with engineering, product, and DevOps teams to ship end-to-end, we'd love to hear from you.
What you'll do
Design and implement scalable data pipelines using Python, PySpark, and boto3 Architect and manage data lakes on Amazon S3, and handle data warehousing, ingestion, and transformation with Amazon Redshift Build and manage batch processing jobs using AWS Glue, EMR, and Lambda Support streaming data workflows with Amazon Kinesis Write efficient SQL for querying, transformations, and performance tuning Use AWS Secrets Manager and KMS for secure data handling a...