Location- Bangalore, Mumbai, Pune
Core (required)
- 6-8 years of experience in data engineering
- Proficient in Python programming — data pipeline development, transformation logic, and automation scripts
- Proficient in data query and analysis using SQL, with strong hands-on experience in Big Query — partitioning, clustering, materialised views, and time-series query patterns at scale
- Hands-on experience building and scheduling pipelines using Cloud Composer (Apache Airflow) — DAG authoring, SLA alerting, retry logic, and dependency management
- Working knowledge of Dataproc (Apache Spark) — batch ingestion, Delta Lake merge operations, and incremental data processing
- Proficient in AI-assisted development tools such as Git Hub Copilot, Cursor, or others for accelerating code generation and enhancing developer productivity
- Code versioning and collaboration using Git — branching strategies, pull request workflows, and pipeline-as-code practices
- Familia...