What are the responsibilities and job description for the Lead Data Engineer position at Stellar IT Solutions?
Job Details
Job Title: Lead Data Engineer
Interview: Virtual
Job Duration: Long term contract
Job Location: Saint Louis, MO
Job Description:
We are seeking a hands-on Lead Data Engineer to lead a small team, oversee end-to-end data pipeline development, and drive technical conversations with stakeholders. The ideal candidate will bring deep expertise in big data technologies and take ownership of testing, validating, and deploying scalable data solutions in a production environment.
Responsibilities:
- Lead and mentor two junior engineers, including code reviews and technical guidance.
- Design, build, and maintain robust data pipelines.
- Manage CI/CD processes for data workflows.
- Interact with customers and upstream stakeholders to align data solutions with business needs.
- Drive proof-of-concept efforts to validate architecture, technology choices, and data workflows.
- Ensure production readiness of big data systems through thorough testing and validation.
Requirements:
- 5 years of experience as a Senior Data Engineer; leadership experience is a strong plus.
- Proficiency with the Big Data ecosystem, particularly Spark and Scala.
- Hands-on experience with Apache Hive and SQL.
- Exposure to AWS is preferred, especially in migration or deployment scenarios.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
