Data Engineer (1410)

Summary :

Please make an application promptly if you are a good match for this role due to high levels of interest.

The Data Engineer is part of a skilled IT team that will work independently and collectively with other engineers to identify and test potential enhancements and resolve technical issues with the rapid scaling of an intelligence application.

Essential Functions :

• Collaboratively develop and implement custom-developed ETL scripts; and support software products as needed.
• Ensure data quality, consistency, and integrity throughout the pipeline.
• Create, monitor, and adjust data ingestion flows.
• Process raw data by transforming it into a usable form (ETL).
• Rapidly create data pipelines to support training exercise with little prior notification to connect fielded systems to cloud-based infrastructure as well as other fielded systems.
• Develop for and work with the ZIngest system, an ingestion system developed by Zapata Technology.
• Perform System Administration functions such as database management, data management, and fixing issues that arise, including the installation of peripheral software and software updates.
• Implement rapid features and API capabilities to meet evolving customer needs for data access and dissemination.
• Interface with the customer(s) to create ingestion feeds for unique systems with ability to implement solutions with few prior known details / documentations about said systems.
• Use source-code control to track and protect changes to the code baseline.
• Manage containerization efforts (Docker, Podman) and orchestration. Upgrade and migrate applications to containers to allow the required scalability and move legacy monolith applications to a microservices type environment. Document Infrastructure administration, tear down, and creation.
• Assist with Automation and Security tasks : Implement Infrastructure as Code (IaC) using Puppet, Ansible or similar technology to meet security mandated change management guidelines. Ensure application and database compliance with DISA and GISA standards and regulations. Work with Cyber-Security personnel to document security vulnerabilities and any mitigations to reduce risks that cannot be removed.

Job Qualifications :

Preferred Qualifications :

Certifications Required :

Education / Experience include :

A bachelor’s degree with 9 to 12 years of experience in performing similar or related work is required. Four years of experience may be substituted for a bachelor’s degree.

Clearance Type :

TS / SCI clearance required.

Travel :

Travel may be required for this role but estimated at 2 weeks or less per TDY and an average of 1-3 times per year.

AAP / EEO Statement :

Zapata Technology is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, genetic information, creed, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

AAP / EEO Employer : Minorities / Females / Disabled / Veterans

J-18808-Ljbffr