What are the responsibilities and job description for the Data Quality Engineer position at Microgreentech?
Role : Data Quality Engineer ETL SDET
Location : Austin TX OR Fort Mill SC (Hybrid)
Key Responsibilities :
- Design develop and implement robust data quality solutions using Informatica PowerCenter and IDQ tools.
- Collaborate with crossfunctional teams to gather requirements understand data quality needs and ensure seamless integration of quality frameworks.
- Conduct data profiling cleansing and standardization to improve overall data accuracy and reliability.
- Develop and execute automated and manual testing frameworks to validate data quality and transformations.
- Monitor and maintain data pipelines and workflows to ensure compliance with organizational and regulatory standards.
- Utilize programming languages like Java Python or Groovy to enhance data quality processes.
- Create detailed documentation for data quality processes frameworks and testing strategies.
- Work with DevOps tools such as Docker Jenkins and Kubernetes for CI / CD pipeline integration.
- Provide ongoing support for datarelated issues troubleshooting and resolving discrepancies efficiently.
Required Qualifications :
Proficiency in programming languages such as Java Python or Groovy.
Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Vacancy : 1
