What are the responsibilities and job description for the Enterprise Databricks Architect - Government Experience position at BigRio?
Enterprise Databricks Architect - Government Experience
Location: Boston, MA-Remote
Duration: 6 Months
About BigRio:
BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver solutions ranging from: custom development, software implementation, data analytics, and machine learning/AI integrations. We are a one-stop shop that attracts clients from a variety of industries because of our proven ability to deliver cutting-edge and cost-conscious software solutions.
With extensive domain knowledge, BigRio has teams of data architects, data engineers, software engineers, web developers, and consultants who deliver best-in-class solutions across a variety of verticals. Our diverse industry exposure equips us with invaluable tools, tricks, and techniques to tackle complex software and data challenges.
Job Description:
We are growing our Data Engineering consulting practice. For a client engagement with the US Government Agency, we are seeking an experienced Enterprise Databricks Architect with a deep understanding of the hospital/ provider data environment. This role is crucial in shaping our client’s data platform strategy, which includes transitioning to cloud-based databases using Microsoft Azure and Azure Data Fabric, with the goal of advancing their data analytics and reporting capabilities.
Responsibilities:
Architect and Implement Data Platforms: Lead the design, implementation, and management of a scalable enterprise data platform using Databricks on Microsoft Azure. Ensure seamless integration with existing systems like Epic and Health Catalyst, and transition to cloud-based data environments.
Cloud Migration: Spearhead the migration of on-premise workloads to Azure, focusing on data analytics and the setup of Azure Data Fabric. Collaborate with the IT team to ensure the Azure environment is prepared for Databricks deployment.
Data Governance and Strategy: Develop and enforce data governance policies to ensure data quality, security, and compliance. Establish strategies for data ownership, segregation based on functions, and support for multimodal data.
Data Transformation and Integration: Oversee custom data transformations, streaming data pipelines, and integration with various data sources including Epic, Infor, Strata, and genomic data registries. Ensure the data is accurately captured and readily available for analysis and reporting.
Collaboration and Leadership: Work closely with a multidisciplinary team including data scientists, IT specialists, and hospital leadership to understand business needs and translate them into technical solutions. Lead discussions on data platform strategies, cloud applications, and data integration methods.
Reporting and Analytics: Support the client’s analytics team by developing a robust data warehouse that enables dynamic reporting and advanced analytics. Ensure the platform supports APIs for data access and feeds into enterprise dashboards, including Power BI.
Future-Proofing: Maintain cloud-agnostic strategies to allow flexibility in future technology choices. Stay aligned with industry trends, particularly in US Government, to ensure the data platform evolves with emerging technologies.
Skills:
Experience: Minimum 8-10 years of experience in enterprise data architecture with MS Azure and Databricks, with at least 5 years in Government settings, particularly in the US Government Agency providers. Strong background in working with cloud-based data platforms, specifically Microsoft Azure and Databricks. Experience with Epic and its integration into enterprise data warehouses is essential.
Technical Expertise: Proficiency in Databricks, Azure Data Fabric, and other cloud technologies. Hands-on experience with Epic, Health Catalyst, and US Government Agency. Familiarity with ERP systems like Infor and their integration into data warehouses.
Certifications:AWS Solutions Architect, Microsoft Azure certifications, or equivalent are highly desirable.
Skills: Strong analytical skills with the ability to translate complex business needs into technical solutions. Excellent communication and leadership skills to work effectively with cross-functional teams.
Education: Bachelor’s degree in Computer Science, Information Technology, or a related field. A Master’s degree or relevant professional certifications is a plus.
Bonus Experience:
- Project work with USAID Agency
Equal Opportunity Statement
BigRio is an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, religion, national origin, sex, sexual orientation, gender identity, age, pregnancy, status as a qualified individual with disability, protected veteran status, or other protected characteristic as outlined by federal, state, or local laws. BigRio makes hiring decisions based solely on qualifications, merit, and business needs at the time. All qualified applicants will receive equal consideration for employment.
