What are the responsibilities and job description for the Azure Data Fabric Engineer position at HireRight?
About HireRight
HireRight is the premier global background screening and workforce solutions provider. We bring clarity and confidence to vetting and hiring decisions through integrated, tailored solutions, driving a higher standard of accuracy in everything we do. Combining in-house talent, personalized services, and proprietary technology, we ensure the best candidate experience possible. PBSA accredited and based in Nashville, TN, we offer expertise from our regional centers across 200 countries and territories in The Americas, Europe, Asia, and the Middle East. Our commitment to get it right every time, everywhere, makes us the trusted partner of businesses and organizations worldwide.
Overview
The EDM data engineer will implement and oversee data pipeline systems that collect, convert and integrate raw data into refinement zones that will apply appropriate business rules. This will make the data more easily consumable by data scientists and business analysts.
Responsibilities
- Design, build, test and deploy new data pipelines within On Prem or Cloud Data Eco-Systems
- Improve existing data pipelines by simplifying and increasing performance.
- Follow best practices and execute architected techniques and solutions for data collection, management and usage to aid in company-wide data governance and management framework.
- Work closely with the data analysts and scientists, and database and systems administrators to create data solutions.
- Evaluate new data sources for quality and attribution to support product requirements.
- Documents new/existing pipelines, Data Sets and Data Sets lineage.
- The work activity includes processing complex data sets, leveraging technologies used to process these disparate data sets and understanding the correlations as well as patterns that exist between these different complex data sets.
Qualifications
- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
- Ability to develop, implement and optimize code using procedural languages such as PL/SQL, T-SQL, etc..
- Experience with SSIS and C# development
- Experience with data normalization and denormalization techniques
- Experience in implementing largescale event based streaming architectures
- Experience data transformation and data processing techniques
- Knowledge of API and Microservice development
- Experience in Agile methodology and/or pair programming
- Strong communication skills
- Strong writing and documentation skills
- Experience in working with cross functional teams, building alignment and collaboration
Preferred Skills and Qualifications
- Knowledge of AI/ML concepts and technologies
- Experience with Stream-processing systems
- Working knowledge of cloud architectures on Azure or GCP
- Certification Azure Data Engineering Associate (DP203) and Implementing Analytic Solutions Using Microsoft Fabric (DP600).
Education and Experience:
- BA/BS in Computer Science or related field, or equivalent experience.
- 5 years of experience in data management and/or data curation.
- 5 years development experience with Oracle and/or SQL Server.
- 5 years of Experience with Python/Pyspark frameworks/libraries.
What do we offer
HireRight does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of HireRight and HireRight will not be obligated to pay a placement fee.
