What are the responsibilities and job description for the MS Fabric / Azure Data Engineer (Need Local candidate) position at Trident Consulting?
Trident Consulting is seeking a "MS Fabric Specialist / Azure Data Engineer” for one of our clients in Newark, NJ/ Hybrid. A global leader in business and technology services
Job title: MS Fabric / Azure Data Engineer
Job Location: Newark, NJ/ Hybrid
Job Type: Contract
Job Summary: Looking for a Sr. MS Fabric developer, who will work with our ML Engineers, Data Scientist, and various BUs to define solutions for operationalizing data-driven decision-making in a cost-effective and scalable manner.
Experience: 8to12Yrs
Required Skills: Python, Fabric, Spark, Azure Service Fabric, Microsoft Fabric - Power BI
Qualifications:
- Bachelors degree in computer science, Software Engineering, MIS, or an equivalent combination of education and experience.
- Experience implementing and supporting data lakes, data warehouses, and data applications on AWS or Microsoft Azure for large enterprises, Fabric is plus
- Programming experience with Python, Spark and SQL.
- Experience with Microsoft Azure services, specifically Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database, KQL.
- Experience in system analysis, design, development, and implementation of data ingestion pipelines in AWS or Azure.
- Solid experience implementing solutions on AWS or Azure-based data lakes - preferred.
- Knowledge of ETL or ELT processes.
- Experience with end-to-end data solutions on ingest, storage, integration, processing, access on AWS or Azure - preferred.
- Architect and implement CI or CD strategies for EDP.
- Implement high-velocity streaming solutions.
- Migrate data from traditional relational database systems, onprem to Azure technologies preferably in Onelake using Fabric technologies preferred.
- Develop data-based APIs
- Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use cases.
- Knowledge of Microsoft Fabric technology focusing on cost and security considerations.
Requirements:
- 5 years of experience as a Data Engineer or Datalakes.
- Experience developing business applications using NoSQL or SQL databases.
- Experience working with Object stores and Structured or semi-structured or unstructured data is a must.
- Experience with Microsoft Azure services like Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database.
- Develop CI or CD pipeline using Terraform and github
- Microsoft Fabric is plus.
Responsibilities:
- Designing, building, and maintaining efficient, reusable, and reliable architecture and code.
- Ensure the best possible performance and quality of high-scale web applications and services.
- Participate in architecture and system design discussions.
- Independently perform hands-on development and unit testing of the applications.
- Collaborate with the development team and build individual components into complex enterprise web systems.
- Work in a team environment with product, frontend design, production operation, QE or QA, and cross-functional teams to deliver a project throughout the whole software development cycle.
- Responsible for identifying and resolving any performance issues.
- Keep up to date with new technology developments and implementations.
- Participate in code reviews to ensure standards and best practices are met
About Trident:
Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements.
Some of our recent awards include:
• 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America
• 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area