Responsibilities
- Design, build, and maintain scalable data pipelines to ingest, process, and transform structured and unstructured data
- Develop and optimize ETL/ELT processes to ensure high data quality, consistency, and reliability
- Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver actionable datasets
- Architect and manage data lakes, warehouses, and cloud-based data platforms (e.g., Azure)
- Implement data models, schemas, and data integration solutions aligned with business needs
- Ensure data governance, security, and compliance standards are followed across all data assets
- Monitor pipeline performance and troubleshoot data-related issues to ensure system stability and uptime
- Automate data workflows and enable real-time or near-real-time data processing where required
- Optimize storage, compute, and processing costs while maintaining performance efficiency
- Stay updated with e...