What are the responsibilities and job description for the Data QE position at TalentOla?
Job Description
- Candidate should be able to carry out the job below and have 3 years of experience in below technical skills.
Technical skills - 1. ETL Data warehousing 2. Advanced SQL 3. Programming (Python/Java) 4. Agile methodologies
- Design and Develop Automated Data Quality Tests:
- Create and maintain automated test scripts and frameworks for data quality validation using tools like Python, SQL, and data quality testing frameworks.
- Develop data profiling and validation rules to identify data anomalies and inconsistencies.
- Build and maintain test data sets for various testing scenarios.
- Implement Data Quality Monitoring and Alerting:
- Integrate automated data quality tests into CI/CD pipelines for continuous testing.
- Set up data quality monitoring dashboards and alerts to proactively identify data issues.
- Develop and maintain data quality reports and metrics.
- Collaborate and Improve Data Quality Processes:
- Work closely with data engineers and product owners to understand data pipelines and requirements.
- Participate in code reviews and contribute to the development of data quality best practices.
- Identify and recommend improvements to data quality processes and tools.
- Investigate and resolve data quality issues, working with relevant teams to implement corrective actions.
- Data Governance and Compliance:
- Ensure data quality testing aligns with data governance policies and regulatory requirements.
- Contribute to the development and maintenance of data quality documentation.
