What are the responsibilities and job description for the Data Engineer with Azure Synapse Analytics (Hybrid Opportunity) position at eSystems, Inc.?
Job Details
Role : Data Engineer with Azure Synapse Analytics and Azure Data Platform
Client : Government of North Carolina(NCDHHS(NCFast))
Work Type: Hybrid
Payrate : 75$ Per Hour
Duration : 12 Months(Extendable)
eSystems Inc. is a fast-growing Systems Integrator based in Princeton, New Jersey. We provide strategic IT solutions and services with primary practice areas in Java and Microsoft centric e-Business solutions, ERP solutions, Enterprise Application Integration, Data Warehousing and Business Intelligence solutions. Our clients include Fortune 500 corporations, government agencies, small and mid-sized local businesses, and non-profit organizations.
The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. Theprimary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security. Key Responsibilities:
- Synapse
- Develop and maintain data models in Synapse to support reporting and analytics
- Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
- Analyze the source system and design the ETL data load.
- Ability to create and configure Azure Synapse Analytics workspace.
- Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources.
- Perform regular monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
- Contribute to cloud infrastructure and security (Azure storage, networking, security, cost management)
- Power BI Tools
- Collaborate with data scientists, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
- Salesforce and MuleSoft
- Knowledge of Salesforce object and data structures
- Design and implement data integrations between Salesforce and Azure Synapse using APIs, ETL tools, and integration platforms like MuleSoft and Azure Data Factory / Azure Synapse Analytics.
- Strong knowledge of Salesforce APIs (REST, SOAP), Apex, and Lightning Web Components
- Familiarity with integration tools like MuleSoft, Informatica, or similar.
- Governance
- Implement and maintain best practices for data governance, security, and compliance.
- Maintain data documentation (data model updates; data dictionary upkeep)
Skill | Required / Desired | Amount(Years) | |
Experience with Azure Synapse Analytics | Required | 4 | |
Experience designing, developing, and managing Synapse pipelines | Required | 4 | |
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) | Required | 4 | |
Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions | Desired | 4 | |
Experience with Data Modeling and Warehousing (star schema, snowflake schema) | Desired | 4 | |
Experience with ETL/ELT processes | Desired | 5 | |
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) | Desired | 1 | |
Experience with Salesforce Integrations | Desired | 3 | |
Experience with Integrations tools (MuleSoft, Informatica, or similar) | Desired | 3 | |
Experience with DevOps and CI/CD (Git and automation tools) | Desired | 5 | |
Experience with infrastructure as code (IaC) tools like Terraform | Desired | 3 | |
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage | Desired | 5 | |
Experience with Lightning Web Components for Salesforce reports | Desired | 2 | |
Experience with Salesforce APIs (REST, SOAP), Apex | Desired | 1 | |
Experience with Cloud Computing | Desired | 1 | |
Experience with Power BI | Desired | 1 |