Qualifications

• Strong hands-on experience with Databricks (PySpark, Delta Lake, notebooks) – core requirement
• Proven ability to build and optimize ETL/ELT data pipelines in a lakehouse environment
• Experience with Azure Data Lake Storage (ADLS Gen2) for scalable data storage
• Hands-on development using Azure Data Factory (ADF) for orchestration and pipelines
• Experience with Azure Functions for serverless data processing
• Solid understanding of lakehouse architecture (Databricks + ADLS integration)
• Strong proficiency in Python and SQL for data transformation and pipeline logic
• Experience with data modeling, partitioning, and performance optimization
• Familiarity with Databricks Unity Catalog (data governance, access control)
• Experience integrating Databricks with ...