As a Sr. Data Engineer, youll design, build, optimize and operate systems on cloud to collect, store, process, package and visualize data to extract insights and make it useable for advanced analytics and machine learning. Youll design data pipelines for batch and streaming data, use big data tools and techniques for processing large amounts of data, and create purpose-built solutions for working with structured, semi-structured, and unstructured data to support analytics and machine learning workloads.

Identify data sources, data formats, and design for data ingestion using batch and real-time techniques Design and build secure, scalable data repositories to store the data, optimizing for cost, compression, scalability, and integration with data processing tools Architect pipelines for data processing and transformation using ETL/ELT, SQL, Apache Spark, and other tools to handle high volume and high-velocity data Design server-less systems for ad-hoc data analysis Use visualiz...