What are the responsibilities and job description for the MS Fabric /ADF architects position at Lorven Technologies, Inc.?
Job Details
Job Title : MS Fabric /ADF architects
Location : NYC, NY | Hybrid
Duration : Long Term
Job Description:
Responsibilities:
- Deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture.
- 6 years of experience in data architecture and engineering.
- Required 2 years hands-on experience with Azure Databricks / ADF and Spark.
- Required recent experience with Microsoft Fabric platform
Microsoft Fabric Expertise:
- Data Integration: Combining and cleansing data from various sources.
- Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.
- Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
- Data Visualization Techniques: Representing data graphically in impactful and informative ways.
- Optimization and Security: Optimizing queries, improving performance, and securing data
Azure Databricks Experience:
- Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.
- Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.
- Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.
- Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)
- Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
- Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
