Become part of a growing team as a mid-level Data Engineer who specializes in streaming data pipelines. Your role will be critical in maintaining data systems in the Cyber domain.
With 3-6 years of related experience, you will design and manage both batch and streaming data pipelines. Your technical skills in programming languages like Python or Go will prove essential, as will your understanding of data formats such as Parquet. You will focus on quality and reliability across all data processes.
Key Responsibilities:
• Design and manage streaming data pipelines
• Develop data ingestion and transformation workflows
• Utilize columnar storage formats including Parquet
• Ensure data quality and pipeline fault tolerance
Requirements:
• 3-6 years of data engineering or related experience
• Expertise in streaming data systems
• Programming experience with Python or Go
• Familiarity with Kafka, Spark, or similar tools
• Solid grounding in data modeling and...