Data Engineer

Job Description

Job Description

Role : Data Engineer

Location : Raleigh, NC

Duration : 6 Months

Required Certification :

Please list all Professional Certifications (ex. Azure Data Engineer Associate Azure Solutions Architect Expert Microsoft Certified : Azure Fundamentals) and the year they were received certifications will be validated

Required Skills :

Experience with Azure Synapse Analytics (4 Years)

Experience designing developing and managing Synapse pipelines (4 Years)

Experience with Azure Data Platform (Azure Data Factory Azure Data Lake and Azure SQL Database) (4 Years)

Preferred Skills :

Familiarity with Event Hubs Azure Stream Analytics and Azure Functions (4 Years)

Experience with Data Modeling and Warehousing (star schema snowflake schema) (4 Years)

Experience with ETL / ELT processes (5 Years)

Experience with Programming and Scripting (SQL T-SQL and data query optimization) (1 Years)

Experience with Salesforce Integrations (3 Years)

Experience with Integrations tools (MuleSoft Informatica or similar) (3 Years)

Experience with DevOps and CI / CD (Git and automation tools) (5 Years)

Experience with infrastructure as code (IaC) tools like Terraform (3 Years)

Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage (5 Years)

Experience with Lightning Web Components for Salesforce reports (2 Years)

Experience with Salesforce APIs (REST SOAP) Apex (1 Years)

Experience with Cloud Computing (1 Years)

Experience with Power BI (1 Years)

Client is seeking a Senior Synapse Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics ensuring data accessibility performance and security for the Child Welfare Program

The Client requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines analytics solutions and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data solutions using Microsoft Azure Synapse Analytics ensuring data accessibility performance and security

Job Responsibilities :

Synapse

Develop and maintain data models in Synapse to support reporting and analytics

Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction transformation and aggregation from Salesforce objects

Analyze the source system and design the ETL data load

Ability to create and configure Azure Synapse Analytics workspace

Create pipelines in Azure Synapse using Linked Services / Datasets / Pipeline to Extract Transform and Load data from different sources

Perform regular monitoring troubleshooting and maintenance of the data architecture and pipelines

Contribute to cloud infrastructure and security (Azure storage networking security cost management)

Power BI Tools

Collaborate with data scientists' analysts and stakeholders to gather requirements design visualizations and provide training to use self-service BI Tools

Salesforce and MuleSoft

Knowledge of Salesforce object and data structures

Design and implement data integrations between Salesforce and Azure Synapse using APIs ETL tools and integration platforms like MuleSoft and Azure Data Factory / Azure

Synapse Analytics

Strong knowledge of Salesforce APIs (REST SOAP) Apex and Lightning Web Components

Familiarity with integration tools like MuleSoft Informatica or similar

Governance

Implement and maintain best practices for data governance security and compliance

Maintain data documentation data model updates data dictionary upkeep