What are the responsibilities and job description for the IS Business Intelligence Data Architect: Azure Data Bricks position at medstar?
The IS Business Intelligence Data Architect assists in architectural oversight and development for MedStar Health's Enterprise Data Warehouse (EDW), data marts and data pipelines. Designs and implements database and BI Solutions that enable the business to derive valuable insights. Partners with stakeholders and subject matter experts to document requirements for data marts, dashboards, and data extracts; and translates those requirements into technical design specifications. Works with MedStar Health's EDW vendor to manage data warehouse data pipelines and optimize the EDW platform. Participates in a range of cross-functional activities related to data governance, standardization of data and reporting, and utilization of BI reports for all areas of the business.
**Primary Responsibilities:**
- Support and maintain the existing ADF and Databricks implementation.
- Lead the design and development of our Databricks-based analytics platform.
- Collaborate with cross-functional teams to ensure data integration and analytics requirements are met.
- Maintain and optimize existing data pipelines using ADF to pull and retrieve data from various sources.
- Optimize data pipelines and workflows for performance and scalability.
- Execute Databricks notebooks to transform and load data into the company Lakehouse.
- Ensure tight integration with Azure DevOps for continuous integration and deployment.
- Troubleshoot and resolve issues related to data pipelines and analytics workflows.
**Preferred Qualifications:**
- Certification in Databricks or related technologies.
- Proven experience with Azure Data Factory and Databricks.
- Proven experience as a Databricks Engineer or similar role.
- Experience with SQL and data warehousing solutions.
- Experience with Azure DevOps for CI/CD.
- Background in Healthcare IT and familiarity with healthcare data standards and regulations.
- Knowledge of machine learning and data science concepts.
**Primary Responsibilities:**
- Support and maintain the existing ADF and Databricks implementation.
- Lead the design and development of our Databricks-based analytics platform.
- Collaborate with cross-functional teams to ensure data integration and analytics requirements are met.
- Maintain and optimize existing data pipelines using ADF to pull and retrieve data from various sources.
- Optimize data pipelines and workflows for performance and scalability.
- Execute Databricks notebooks to transform and load data into the company Lakehouse.
- Ensure tight integration with Azure DevOps for continuous integration and deployment.
- Troubleshoot and resolve issues related to data pipelines and analytics workflows.
**Preferred Qualifications:**
- Certification in Databricks or related technologies.
- Proven experience with Azure Data Factory and Databricks.
- Proven experience as a Databricks Engineer or similar role.
- Experience with SQL and data warehousing solutions.
- Experience with Azure DevOps for CI/CD.
- Background in Healthcare IT and familiarity with healthcare data standards and regulations.
- Knowledge of machine learning and data science concepts.
