Job Summary
We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks, Snowflake, and modern data engineering practices. The ideal candidate should have hands-on experience in building scalable batch and streaming data pipelines, optimizing Spark jobs, and working with large-scale distributed data systems.
Requirements
Key Responsibilities
Design, develop, and maintain scalable data pipelines (batch & streaming)Build and optimize data processing workflows using PySpark and SQLWork with Databricks for data processing, cluster management, and job orchestrationImplement and manage data pipelines using Delta Lake architectureIntegrate data from multiple sources including Kafka and cloud storage systemsEnsure data quality, governance, and reliability across pipelinesCollaborate with cross-functional teams for data platform enhancementsTroublesho...