What are the responsibilities and job description for the Azure Data Engineer position at Digitive LLC?
Job Details
Title: MS Fabric / Azure Data Engineer
Location: - Newark, NJ
Years of Experience: 12.00 Years of Experience
Job Title: MS Fabric / Azure Data Engineer
Job summary : Looking for a Sr. MS Fabric developer, who will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data driven decision making in a cost effective and scalable manner.
Experience : 8to12Yrs
Required Skills : ,Python, Fabric, Spark, Azure Service Fabric, Microsoft Fabric - Power BI
Qualifications :
1. Bachelors degree in computer science, Software Engineering, MIS, or an equivalent combination of education and experience.
2. Experience implementing and supporting data lakes, data warehouses, and data applications on AWS or Microsoft Azure for large enterprises, Fabric is plus
3. Programming experience with Python, Spark and SQL.
4. Experience with Microsoft Azure services, specifically Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database, KQL.
5. Experience in system analysis, design, development, and implementation of data ingestion pipelines in AWS or Azure.
6. Solid experience implementing solutions on AWS or Azure-based data lakes - preferred.
7. Knowledge of ETL or ELT processes.
8. Experience with end to end data solutions on ingest, storage, integration, processing, access on AWS or Azure - preferred.
9. Architect and implement CI or CD strategies for EDP.
10, Implement high velocity streaming solutions.
11. Migrate data from traditional relational database systems, onprem to Azure technologies preferably in Onelake using Fabric technologies preferred.
12. Develop data based APIs
13. Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use cases.
14. Knowledge of Microsoft Fabric technology focusing on cost and security considerations.
Requirements :
1. 5 years of experience as a Data Engineer or Datalakes .
2. Experience developing business applications using NoSQL or SQL databases.
3. Experience working with Object stores and Structured or semi structured or unstructured data is a must.
4. Experience with Microsoft Azure services like Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database.
5. Develop CI or CD pipeline using Terraform and github
6. Microsoft Fabric is plus.
Responsibilities:
1. Designing, building, and maintaining efficient, reusable, and reliable architecture and code.
2. Ensure the best possible performance and quality of high scale web applications and services.
3. Participate in architecture and system design discussions.
4. Independently perform hands on development and unit testing of the applications.
5. Collaborate with the development team and build individual components into complex enterprise web systems.
6. Work in a team environment with product, frontend design, production operation, QE or QA, and cross functional teams to deliver a project throughout the whole software development cycle.
7. Responsible for identifying and resolving any performance issues.
8. Keep up to date with new technology developments and implementations.
9. Participate in code reviews to ensure standards and best practices are met.
Certifications Required : Any Cloud Certification preferred Azure or AWS preferred
