Business Title: Data Engineer

Location: Durham, NC (100% Remote Job)

Job Type: 12 months contract

***REMOTE POSITION***

Job Responsibilities

• Responsible for the design, delivery, support, and maintenance of industrialized automated end to end data services and pipelines
• Apply standardized data models and mapping to ensure data is accessible for end users in end-to-end user tools through use of APIs
• Define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance
• Acquire and process internal and external, structure and unstructured data in line with product requirements
• Serve as a technical contributor who can take a well-defined specification for a function, pipeline, service, or other sort of component, and a technical approach to building it, and deliver it at a high level
• Use a python API to the external source to get a content inventory, collect the content and ingested in GCP data platform
• Uplift business data transform logic to industrial pipeline orchestrated with Ingestion
• Identify new data that does not conform/fails existing mappings
• Register successful data in data governance platform and surface for users and downstream processes
• Generate reports to business on “failed” source data.

Skills & Experience Required

• Bachelor's degree in relevant field
• 5 years of experience
• Knowledge and use of a common data transformation programming language (external source API is developed for python)
• Fundamental understanding of firewall/perimeter security
• Knowledge and use of a common data transformation programming language (business code will be in python)
• Modular code design with failure resilient program flow experience