Job Description
Insight Global is seeking a Data Engineer to support a Joint Staff J7 program in Suffolk, VA. This team supports military training efforts by enabling data-driven solutions that help prepare forces to respond to global operations and crisis scenarios.

Responsibilities include but are not limited to:

Designing, developing, testing, and operating ETL/ELT data pipelines using tools such as Apache Spark
Ensuring data pipelines are reliable, performant, and cost-effective
Defining and enforcing data quality checks to maintain accuracy and integrity of data
Diagnosing and resolving issues across data ingestion, transformation, and query processes
Documenting workflows, processes, and data definitions to support knowledge sharing across teams
Maintaining up-to-date documentation in Confluence, including data dictionaries
Participating in data cataloging efforts and ensuring adherence to security and compliance requirements
Collaboratin...