What are the responsibilities and job description for the Data Engineer position at clearAvenue?
Data Engineer Job Description
The Data Engineer will build, extract, transform, load (ETL) pipelines to enable full spectrum data operations from ingest to query within a team that is responsible for developing and sustaining a cloud-based platform that enables cyber operations across the contract’s agency. This position will support a team to coordinate and integrate work across legacy Big Data Platforms and assist the team with the overall goal of developing new applications, analytics, and services to modernize capabilities through an agile, evolving requirement identification and prioritization process.
Responsibilities:
Requirements and Qualifications:
Other Duties Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.
clearAvenue, LLC is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or disability status, protected veteran status, or any other characteristic protected by law.
The Data Engineer will build, extract, transform, load (ETL) pipelines to enable full spectrum data operations from ingest to query within a team that is responsible for developing and sustaining a cloud-based platform that enables cyber operations across the contract’s agency. This position will support a team to coordinate and integrate work across legacy Big Data Platforms and assist the team with the overall goal of developing new applications, analytics, and services to modernize capabilities through an agile, evolving requirement identification and prioritization process.
Responsibilities:
- Design and implement data solutions using industry best practices.
- Performs ETL, ELT operations and administration of data and systems securely and in accordance with enterprise data governance standards.
- Monitor and maintain data pipelines proactively to ensure high service availability.
- Works with Data Scientists and ML Engineers to understand mathematical models and optimize data solutions accordingly.
- Continuous development through training and mentorship programs.
- Create scripts and programs to automate data operations.
Requirements and Qualifications:
- Minimum Bachelor’s Degree in Data Science, Engineering, Computer Science, or related fields.
- 5 years of minimum total relevant experience.
- Current DoD 8570 training and certifications such as a Security , CISM, CISP, etc.
- Experienced working in an Agile Scrum environment.
- Experienced working in a cloud-based and AI/Machine Learning data technologies.
- Experienced working in a government contract environment, ideally with the Department of Defense.
- Thorough understanding of the responsibilities and duties of a data engineer, as well as established industry standards/best practices and documentation guidelines.
- Excellent problem-solving skills and ability to learn through scattered resources.
- Outstanding communication skills, and the ability to stay self-motivated and work with little or no supervision.
- Active Top Secret Security clearance with SCI eligibility
Other Duties Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.
clearAvenue, LLC is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or disability status, protected veteran status, or any other characteristic protected by law.
