Key Responsibilities
Technical Leadership & Ownership
- Own the end-to-end data engineering architecture for large-scale AWS data platforms
- Define and enforce data engineering standards, best practices, and governance frameworks
- Lead design reviews, code reviews, and technical decision-making across teams
- Act as the primary technical escalation point for complex data pipeline issues
ETL/ELT Design & Development
- Design, build, and optimize scalable ETL/ELT pipelines using:
- AWS Glue (Jobs, Workflows, Crawlers)
- PySpark / Spark SQL, Snowflake, SnowsQL
- Python-based data processing frameworks
- Implement incremental processing, CDC, and data partitioning strategies
- Develop reusable and modular data pipeline frameworks for enterprise use
Data Lake & Storage Management