Description
Our client is an American video game company.
#LI-JF4
Responsibilities
Migrate current Data pipelines and DAGs from GCP BigQuery stored procedures into AWS Redshift Perform necessary data backfills and validate the quality and integrity during and post-migration Design, develop, and maintain data pipelines using AWS services such as Amazon Redshift (or any MPP solution), Amazon S3, dbt and Apache Airflow Utilize SQL and ETL/ELT solutions to transform and load data from various sources into data warehouses and data lakes Optimize data workflows and processes to ensure efficiency, scalability, and reliability Implement auto-updated mechanisms to keep data pipelines and systems up-to-date with the latest data Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs Mon...