Job ID: 10171
Job Function: Administration
Institution: National University Health System
Responsibilities - Data Pipeline Development & Management
- Design, develop, and maintain robust ETL/ELT pipelines to process large volumes of structured data
- Implement batch data processing solutions using Databricks
- Monitor data pipeline performance and troubleshoot issues to ensure reliable data flow
- Optimize existing pipelines for improved performance and cost efficiency
- Data Architecture & Infrastructure
- Collaborate with senior engineers to design and implement scalable data architectures
- Build and maintain data warehouses, data lakes, and cloud-based storage solutions
- Ensure data quality, consistency, and reliability across all systems and datamarts
- Implement data governance best practices and security protocols defined by MOH HIM policies...