What are the responsibilities and job description for the Senior Data Engineer position at Softworld, a Kelly Company?
Sr Data Verification Engineer
Location : Sunnyvale, CA (100% onsite)
Duration : 1 year
We are currently recruiting for a Sr Data Verification Engineer to work in 100% onsite model in Sunnyvale. The ideal candidate will have strong python and SQL. There will be a coding challenge during interview. Candidates should also have experience in building and automating test processes to ensure data quality and reliability within a data science platform. They should possess expertise in developing automated tests for data applications and demonstrate a deep understanding of database concepts and complex data relationships.
The Senior Data Verification Engineer is responsible for building and automating test processes and workflows to ensure data quality and support data validation across interdependent components of a central data science platform.
In this role, you will have the opportunity to :
Develop and implement automated test cases to ensure reliability of applications, data pipelines, deployment and migration processes.
Perform technical troubleshooting, identify bottlenecks, and conduct initial root cause analysis for data issues, collaborate to identify the scope of the issue, and path to resolution.
Build models that measure and evaluate the quality, consistency, resilience, accuracy, and availability of the current data ecosystem.
Analyze and communicate impacts of data updates, changes, additions / removals to technical and non-technical partners.
Create design (data flow diagrams, technical design specs, source to target mapping documents) and test (unit / integration tests) documentation.
The essential requirements of the job include :
Bachelor’s degree in software engineering, computer science or a similar field with 5 years of related work experience, OR Master’s degree with 3 years of related work experience.
Working knowledge of Python and SQL.
Experience building automated tests for production-grade cloud software applications, pipelines, and deployment processes.
Experience with database and data relation concepts such as mapping documents and complex data relationships.
Excellent communication, collaboration and problem-solving skills and ability to address complex data issues and investigate systemic defects.
