Data Engineer (Active Top Secret clearance required)

ASG is seeking a mid-level Data Engineer for the Department of Defense (DoD) contract will support the configuration and ingestion of structured, unstructured, and semi-structured data into systems that meet mission partner requirements, contributing to a data analytics and DevOps pipeline for rapid delivery. They will maintain data transfer operations, ensuring the security of infrastructure, systems, and applications, and monitor the health of the environment. The role includes automating configuration management, staying up to date with ETL technologies, and working independently to identify areas for optimization and cost reduction. The Data Engineer will leverage expertise in databases, Cloud architecture, and data engineering technologies, collaborate with teams to solve client challenges, and develop scalable, efficient coding solutions. Additionally, they will maintain existing web scraping tools and assist in the design, implementation, and deployment of full features and components of solutions.

What You Will Do:

• Support the configuration and ingestion of designated structured, unstructured, and semi-structured data repositories into capabilities that satisfy mission partner requirements and support a data analytics and DevOps pipeline to drive rapid delivery of functionality to the client.
• Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities.
• Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services.
• Work under general guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment.
• Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles.
• Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy full features and components of solutions.
• Identify and implement scalable and efficient coding solutions.

Requirements

What We Need:

• Bachelor’s degree plus 5-7 years experience, or a Masters Degree plus 3 years of experience.
• Experience with Big Data systems, including Apache Spark / Databricks.
• Experience with ETL processes; • Experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0.
• Applying DoD Security Technical Implementation Guides (STIGs) and automating that process.
• Experience with multiple coding languages.

Clearance Required:

• US Citizenship required.
• Possess a minimum of an active Top Secret (TS) security clearance with Sensitive Compartmented Information (SCI) eligibility.