Build & maintain high tps, reliable, performant and cost-effective data collection and extraction modules using Node.js & Python, using streaming solutions like Kafka.
Deploy, maintain and support these modules on AWS & GCP cloud.
Index, archive and retain necessary data in multiple persistence stores like Object stores(S3), Key value store (Dynamo DB), and Elastic Search based on the use case.
Manage the quality of data collected using data quality libraries built using SQL/Python/Spark on AWS Glue and exposed as Dashboards for monitoring using AWS Quick sight and Kibana.
Restfully abstract the data collected to the downstream applications through a Node.js backend.
Collaborate well with engineers, researchers, and data implementation specialists to design and cre...
Ready to Apply?
Join thousands of Americans building their careers