Roles & Responsibilities
• Develop Databricks notebooks, jobs, and workflows to replicate and enhance DB2/Guidewire-based pipelines and transformations.
• Implement Delta Lake tables and patterns (bronze/silver/gold, ACID, time travel, schema evolution) for migrated data.
• Integrate Databricks with AWS/S3 or Azure ADLS, ADF/Synapse, Key Vault, and Snowflake as required.
• Optimize Databricks clusters, jobs, and queries for performance and cost.
• Implement incremental loads, CDC patterns, and batch schedules for large datasets.
• Collaborate with Snowflake and dbt teams to ensure consistent data models and data contracts.
• Participate in data validation and reconciliation between DB2 400 / Guiderwire and Databricks outputs.
• Follow coding standards, version control, and CI/CD practices using Git/Azure DevOps.
• Provide defect fixes and support during SIT/UAT and post go-live stabilization.

Experience :