Designing and implementing data pipelines from multiple sources using Azure Databricks or Hadoop ecosystem.
Developing scalable and re-usable frameworks for ingesting of data sets.
Integrating end to end data pipeline - to take data from source systems to target data repositories ensuring quality and consistency of data is maintained at all times.
Working with event based / streaming / scheduling technologies to ingest and process data.
Write python script to process data according to the needs from other engineers.
Build dashboard using Power BI or Tableau to fulfill the need from end users.
Evaluating the performance and applicability of multiple tools for the automated data pipeline.
Involve in application development using low-code platforms such as PowerApps and OutSystems.
Involve in AI solution development in the organization focus on building python script for data processing.<...
Ready to Apply?
Join thousands of Americans building their careers