Job Summary
We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks, Snowflake, and modern data engineering practices. The ideal candidate should have hands-on experience in building scalable batch and streaming data pipelines, optimizing Spark jobs, and working with large-scale distributed data systems.
Requirements
Key Responsibilities
- Design, develop, and maintain scalable data pipelines (batch & streaming)
- Build and optimize data processing workflows using PySpark and SQL
- Work with Databricks for data processing, cluster management, and job orchestration
- Implement and manage data pipelines using Delta Lake architecture
- Integrate data from multiple sources including Kafka and cloud storage systems
- Ensure data quality, governance, and reliability across pipelines
- Collaborate with cross-functional te...