What are the responsibilities and job description for the Data Engineer position at Core4ce?
Job Description
Core4ce is looking for Data Engineers to join our team supporting the CDAO effort which is responsible for the acceleration of the DoD's adoption of data, analytics, and AI to generate decision advantage from the boardroom to the battlefield. The CDAO is the lead for all AI work within the DoD.
Responsibilities
- Support the configuration and ingestion of designated structured, unstructured, and semi-structured data repositories into capabilities that satisfy mission partner requirements and support a data analytics and DevOps pipeline to drive rapid delivery of functionality to the client;
- Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities;
- Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services;
- Work under general guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment;
- Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles;
- Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy full features and components of solutions
- Maintain an existing collection of web scraping tools used as the initial step of the ETL process
- Identify and implement scalable and efficient coding solutions
Requirements
Active TS (SCI Eligibility) Required
All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status.
