Data Engineer

Job Summary:

We are looking for a skilled Data Engineer with strong Python and Azure expertise. The role involves building and maintaining scalable data pipelines in Databricks, optimizing workflows, and supporting data analytics with tools like Power BI.

Key Responsibilities:

Build and maintain ETL pipelines using Databricks and PySpark
Work closely with data scientists, analysts, and stakeholders
Optimize and troubleshoot data workflows
Implement data governance and security best practices
Use Python for data processing and analysis
Leverage Azure services (Data Lake, Data Factory, Synapse, etc.)
Create reports and dashboards using Power BI

Requirements:

Bachelor's in computer science or related field
5 years of experience in data engineering and Python
3 years with Azure services and Databricks
Experience with healthcare data (HL7, CCDAs, EDI - 835/837, FHIR, claims, etc.)
Familiarity with Git/GitHub and Power BI
Strong ETL and data warehousing skills
Good communication and collaboration skills
Familiarity with AI/Copilot

Preferred:

PySpark development in Databricks
Experience with Tableau, Qlik, or SAS
Knowledge of big data (Spark, Hadoop)
Azure or Databricks certification