What are the responsibilities and job description for the Data Engineer Data Lineage & Data Quality :: New York/New Jersey (Hybrid (alternate week onsite) position at DataFactZ?
Job Details
Job Title: ETL Data Engineer Data Lineage & Data Quality
Location: New York/New Jersey (Hybrid (alternate week onsite)
Duration: Contract
Job Description:
We are seeking hands-on ETL Data Engineers with deep expertise in building data pipelines, data lineage, and data quality for a large financial services customer. The role requires strong technical skills in ETL tools, data lineage tools, and data quality tools while being able to navigate and reverse-engineer complex codebases. As part of a larger data lineage and data quality initiative, you will work with a diverse set of tools to analyze, document, and enhance existing data pipelines. The ideal candidate must be comfortable getting hands-on with the underlying technology stack, tracing data movement, and building lineage frameworks.
Key Responsibilities:
- Analyze and reverse engineer existing ETL data pipelines to build lineage and improve visibility into data movement.
- Work with data lineage and data quality tools such as Informatica EDC, IDQ, Ab Initio, Alation, and custom connectors for lineage extraction.
- Configure and implement data catalog and lineage tools to ensure accurate and comprehensive data flow tracking.
- Develop and implement data quality rules and automated testing frameworks for data validation.
- Work across ETL technologies (Informatica, Datastage, Ab Initio) to extract metadata and enhance lineage.
- Navigate SQL and Unix-based platforms, analyzing system workflows and data transformations.
- Collaborate with data governance, data engineering, and business teams to improve data transparency and compliance.
- Document findings and develop best practices for data lineage, quality, and governance.
Required Skills & Experience:
- 5 years of hands-on experience in ETL development with tools such as Informatica, Datastage, Ab Initio.
- Strong expertise in data lineage tools (Informatica EDC, Alation, Collibra) and data quality tools (IDQ, Ab Initio).
- Ability to reverse engineer code, analyze existing ETL workflows, and trace data flow across systems.
- Proficiency in SQL, Unix/Linux scripting, and working with large-scale enterprise databases.
- Experience in configuring and building connectors for metadata extraction.
- Strong problem-solving skills and ability to work independently in a highly technical environment.
- Financial services experience is a plus.
