Job Information Work Experience 1-3 years
Technology
SGD 4000 -SGD 4500
City Singapore
State/Province Central Singapore
Job Description Data engineer (Azure) – Synapse and Pyspark, Python, Datawarehouse and Azure Data Explorer, Azure Devops
Job Scope - Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration.
- Designing and developing reports and dashboards in PowerBI, setting up access control with row level security DAX query experience.
- Establishing connections to source data systems such as on-prem databases, IOT devices, APIs.
- Managing the collected data in appropriate storage/data-base solutions e.g. file systems, SQL servers, Big Data platforms such as Hadoop, HANA, etc. as required by the specific project requirements.
- Design, development of relevant data pipelines using pyspark, copy data activities ...