What are the responsibilities and job description for the ITY005 Data Engineer - AWS API Development position at Warriors Recruiting?
Job Title : Data Engineer – Developer with AWS API Skills
Location : Remotewith travel to Waukegan, IL (current estimate is 10%)
Clearance : Clearable US Citizen
Our great client is seeking a talented Data Engineer to join our Data aNd Analytics (DNA) team, who will be responsible for architecting, developing, and maintaining a multi-system data pipeline inside an AWS ecosystem. This position will support a new development activity for a client Chief Data Officer initiative to build an enterprise data exchange , brokering internal and external application data via the pipeline. Your skills in AWS tools and environments will be invaluable to this team. This is a remote position with an expectation of occasional client site visits.
You’ll be working on our prime contract supporting the USMEPCOM, a major command within the U.S. Department of Defense (DoD), responsible for screening and processing applicants into the U.S. Armed Forces. USMEPCOM operates 65 Military Entrance Processing Stations (MEPS) across the U.S., serving as the critical link between recruitment and training for the armed forces.
Key Responsibilities :
- API Development & Management :
- Design, build, and maintain scalable RESTful and event-driven APIs using AWS API Gateway .
- Develop and optimize integrations between APIs and services such as AWS Lambda , RDS , S3 , and Step Functions .
- Implement API Gateway security features, including API keys, Secrets Manager, IAM roles, and resource policies.
- Create detailed API documentation and manage versioning, stages, and deployments.
- Data Engineering :
- Design, build, and maintain ETL / ELT pipelines to process and ingest data from multiple sources using API.
- Work with structured and unstructured data in cloud storage systems like S3, Athena, RDS, and Redshift.
- Create and manage data models, schemas, and database designs to support analytics and applications.
- Development Skills :
- Write clean, efficient, and maintainable code in programming languages like Python .
- Develop serverless applications using AWS Lambda functions integrated with API Gateway.
- Collaborate with Product Owners and application teams via agile scrums to identify source data targets.
- Collaborate with data analysts and scientists to ensure data readiness for analytics use cases.
- Prepare code for integration into a CI / CD pipeline for automated deployment of APIs and data workflows.
- Knowledge of Infrastructure as Code (IaC) tools such as AWS CloudFormation and Terraform to ensure DevSecOps team can deploy applications.
Required Skills & Qualifications :
Soft Skills :
Preferred Qualifications :
