What are the responsibilities and job description for the Data Engineer position at AD IT Solution?
Job Details
No Of Position 3
1 Senior
2 Junior
Role: Data Engineer
Work Location: Onsite at Bellevue Office
Expected Start Date: ASAP
Overview
We are seeking a seasoned Data Engineer to join our data engineering team that works with Microsoft RAI API team. The ideal candidate will be responsible for validating and correcting label quality after human labeling, as well as cleaning our TMS/IMS/Jailbreak training and evaluation dataset. This role requires a strong background in data engineering, coding skills, and experience in data validation and cleaning processes, with a focus on the specific tech stack used by the API RAI team.
Responsibilities
- Validate human labeling results in the data pipeline to ensure data accuracy and consistency.
- Understand data labeling requirements, propose solutions for how upper stream data labeling team should correct label quality by performing root cause analysis based on data quality evaluation
- Clean and preprocess TMS/IMS/Jailbreak training and evaluation datasets to maintain high-quality data standards.
- Collaborate with the API RAI team to understand data requirements and provide data solutions.
- Develop and implement data pipelines and workflows to automate data processing tasks.
- Monitor and maintain data quality throughout the data lifecycle.
- Work closely with cross-functional teams to support data-driven decision-making.
- Working with internal team to create business plans for strategic growth.
- Other responsibilities assigned by the CSI management team for business development.
Requirement
- Bachelor's degree in Computer Science, Data Engineering, Data Science or a related field.
- 5 years experience as a data engineer, analytics engineer, software engineer
- Strong coding skills in C#, Python, and SQL.
- Experience with Azure DevOps (ADO) and pipeline maintenance.
- Familiarity with Azure services and Azure Data Factory (ADF).
- Proven experience in automation and data engineering.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Prior experience related to human labeled data quality evaluation process is strongly preferred.
- Experience with Microsoft is preferred
- Knowledge of machine learning and AI concepts.
- Prior experience with evaluation of data quality and identifying bottlenecks.
- Familiarity with data visualization tools (e.g., Power BI, Tableau).
- Experience working in an Agile development environment.
- Team leading experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
