Responsibilities

• Design, build, and maintain scalable, efficient data pipelines and systems
• Evaluate and prototype new tools and technologies, assessing risks and benefits
• Build and maintain scalable data pipelines and models using Databricks, dbt, and SQL
• Develop robust data solutions leveraging AWS services including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch
• Implement data transformations and integrations using Python and Java
• Implement infrastructure-as-code using Terraform
• Monitor and optimize system health using CloudWatch and Splunk
• Mentor junior engineers and conduct code reviews
• Collaborate with cross-functional stakeholders in agile environments

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 10+ years of professional experience in data engineering
• Deep expertise in Databricks