What are the responsibilities and job description for the ITY004 Data Engineer - Database Focused position at Warriors Recruiting?
Job Title : Data Engineer – Database Developer
Location : Remotewith travel to Waukegan, IL (current estimate is 10%)
Clearance : Clearable U.S Citizen
Our great client is seeking a talented Data Engineer to join our Data and Analytics (DNA) team, who will be responsible for design, developing, and maintaining the data infrastructure supporting a business intelligence, data exchange, and scalable data infrastructure on an AWS ecosystem . This candidate will support a new development activity for a client Chief Data Officer initiative to build a semantic data layer and enterprise data warehouse , brokering internal and external application data throughout the ecosystem. The ideal candidate will have hands-on experience with Amazon RDS , AWS Lambda, Python Glue, SQL-based data solutions, and a strong understanding of data pipelines, ETL processes, warehouse concepts , and cloud-based architecture. You will collaborate closely with data scientists, analysts, and cross-functional teams to ensure robust data availability and accessibility. This is remote position with an expectation of occasional client site visits.
You’ll be working on our prime contract supporting the USMEPCOM, a major command within the U.S. Department of Defense (DoD), responsible for screening and processing applicants into the U.S. Armed Forces. USMEPCOM operates 65 Military Entrance Processing Stations (MEPS) across the U.S., serving as the critical link between recruitment and training for the armed forces.
Key Responsibilities :
- Design & Development :
- Architect and implement scalable data storage solutions using AWS services like Amazon RDS, S3, Redshift, Lambda, Python and Glue.
- Write and optimize complex SQL queries for data retrieval and processing on RDS.
- Develop, optimize, and maintain data pipelines to support data transformation and integration.
- ETL / ELT Pipelines :
- Design, build, and manage ETL / ELT pipelines to ingest data from various sources into AWS storage layers.
- Use AWS Glue, Lambda, or custom scripts (Python and SQL) for data transformation and orchestration.
- Performance Optimization :
- Monitor, analyze, and optimize database and query performance on Amazon RDS.
- Collaborate with teams to refine data models and indexing strategies.
- Collaboration & Communication :
- Partner with stakeholders to define data requirements and ensure seamless integration with data systems.
- Provide documentation and training for other engineers and analysts.
Required Skills and Qualifications :
Soft Skills :
Preferred Qualifications :