About Position:

We are looking for an experienced Databricks Lead who can build, optimize, and maintain scalable data pipelines on the Databricks platform.

- Role: Databricks Lead
- Location: Pune/Gurgaon/Bangalore
- Experience: 9+ years
- Job Type: Full Time Employment

What You'll Do:

- Develop and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks).
- Implement data processing workflows across Bronze, Silver, and Gold layers using Delta Lake.
- Build and optimize batch and streaming pipelines using Structured Streaming.
- Perform Spark performance tuning, job optimization, and cost optimization.
- Collaborate with data architects, analysts, and business teams to deliver scalable data solutions.
- Ensure data quality, data validation, and adherence to governance policies.
- Integrate Databricks with cloud-native services (Azure/AWS/GCP).
- Use Git and follow CI/CD best practices for code versioning and...