What are the responsibilities and job description for the Azure Fabric - Data Engineer / Architect position at Aptino, Inc.?
Role: Azure Fabric - Data Engineer / Architect
Location: Whippany, NJ (Hybrid- 3 days/week from office)
Duration: 12 month
We are looking for an experienced Azure Fabric - Data Engineer / Architect to design, implement, and optimize data solutions using Microsoft Fabric and Azure Data Services. The ideal candidate will have a strong background in data architecture, data engineering, and cloud-based analytics, ensuring efficient data processing, storage, and insights delivery across the organization.
Key Responsibilities:
- Data Architecture & Strategy: Design and implement scalable, cloud-native data architectures leveraging Microsoft Fabric, Azure Synapse, and Data Lake.
- Data Engineering & Integration: Develop ETL/ELT pipelines using Fabric Dataflows, Azure Data Factory, Synapse Pipelines, and Databricks for seamless data ingestion and transformation.
- Data Modeling & Optimization: Design efficient data models in Lakehouse architecture, optimizing performance for analytical workloads.
- Data Security & Governance: Implement RBAC, data masking, encryption, and Purview integration to ensure compliance with security and governance standards.
- Real-time & Batch Processing: Build and manage real-time data streaming solutions using Azure Event Hubs, Stream Analytics, and Kafka, along with batch processing frameworks.
- BI & Analytics Enablement: Work closely with business intelligence teams to enable self-service reporting through Power BI and Fabric Analytics.
- Automation & DevOps: Automate deployments and data workflows using Azure DevOps, CI/CD pipelines, and Infrastructure-as-Code (IaC) tools like Terraform or Bicep.
- Collaboration & Leadership: Collaborate with cross-functional teams, mentor junior engineers, and drive best practices in data engineering and cloud analytics.
Required Skills & Qualifications:
- Experience: 5 years in data engineering, data architecture, or cloud-based analytics with a focus on Azure Data Services.
- Expertise in Microsoft Fabric: Hands-on experience with Fabric Dataflows, Lakehouse, Synapse, Data Factory, and OneLake.
- Azure Data Stack: Strong knowledge of Azure Data Lake, Azure SQL, Databricks, Synapse Analytics, and Cosmos DB.
- Programming & Scripting: Proficiency in Python, SQL, Spark, and PowerShell for data processing and automation.
- Big Data & Streaming: Experience working with Delta Lake, Parquet, Apache Spark, and real-time data processing tools.
- Data Security & Compliance: Knowledge of GDPR, HIPAA, SOC 2 compliance, and best practices in cloud data governance.
- Certifications (Preferred):
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Fabric Analytics Engineer Associate
