Data Engineer

Job Title: Data Engineer

Interview: Virtual

Job Duration: C2H

Job Location: 100% Remote



We are seeking a Data Engineer II to support the design, development, testing, and deployment of software applications for a new program. This role requires a strong technical background, exceptional problem-solving abilities, and the capacity to collaborate effectively within a SAFe Agile framework.



Key Responsibilities:

• Lead the design, development, and implementation of advanced ETL pipelines utilizing Apache NiFi and Java Spring Boot microservices, enabling the ingestion, transformation, and integration of large, complex datasets from multiple sources.
• Provide technical expertise in Java programming, Spring Boot microservices, and big data technologies in an AWS cloud environment (Redshift, Athena, etc.).
• Demonstrate deep knowledge of data integration principles, ETL best practices, and data governance frameworks, with familiarity in machine learning concepts and data preparation techniques.
• Optimize existing ETL scripts for improved performance and scalability.
• Conduct comprehensive analysis to integrate complex data sources into unified systems, developing optimal data ingestion strategies.
• Collaborate with data scientists and machine learning engineers to support model development through data preparation and analysis.
• Lead the creation and maintenance of detailed data documentation, including database design, configuration, and performance reports.
• Establish and enforce best practices for secure data storage, backup, and archiving, ensuring compliance with relevant regulations.
• Collaborate with data management teams and stewards to implement data governance initiatives.
• Promote a collaborative and supportive team environment, fostering knowledge sharing and continuous learning.
• Effectively communicate technical concepts to both technical and non-technical stakeholders. Represent the data engineering team in meetings, addressing technical challenges and progress.
• Delegate tasks and manage project timelines and budget constraints to ensure successful project completion.
• Mentor junior data engineers, offering technical guidance and encouraging professional growth.

Qualifications:

Required:

• BS/BA degree with 2 years of experience or MS/MA degree with 0 years of experience.
• Must be able to obtain and maintain a Public Trust clearance.
• Extensive expertise with Apache NiFi, Java, Java Spring Boot microservices, AWS (Redshift, Athena), and big data technologies.
• Experience with CI/CD processes.

Preferred:

• BS/BA degree with 5 years of experience or MS/MA degree with 3 years of experience.
• Agile/SAFe certification.
• Knowledge of AWS or AWS GovCloud and AWS native tools.
• Familiarity with SonarQube, Burp Suite, Apache JMeter, New Relic, Splunk, and Grafana.
• Experience with RESTful APIs, Angular development, HTML, CSS, JavaScript, Jenkins, Ansible, LaunchDarkly, and Nexus.
• Experience working with CMS or other federal healthcare programs.
• Strong leadership, communication, and collaboration skills.
• Familiarity with JIRA.