What are the responsibilities and job description for the Manager, Data Engineering position at HealthVerity?
How you will help
As Manager of Data Engineering on the R&D Team, you will lead a team of engineers developing scalable data solutions to support HealthVerity's research and innovation efforts. You will collaborate with software engineers and product teams to design high-performance data architectures that enable cutting-edge analytics and real-world data applications. Your leadership will drive efficient data pipelines, ensuring data integrity, accessibility, and compliance in a fast-paced, research-driven environment.
What you will do
- Lead and mentor a team of 5–10 data engineers, fostering technical excellence and growth.
- Design and optimize scalable data pipelines to process large structured and unstructured datasets.
- Collaborate with researchers, data scientists, and engineers to develop high-quality data solutions.
- Enhance data storage, retrieval, and processing capabilities for advanced analytics.
- Ensure data security, privacy, and regulatory compliance.
- Automate and optimize data engineering processes for efficiency and scalability.
- Integrate data solutions into HealthVerity's R&D ecosystem.
- Evaluate emerging technologies to improve data infrastructure and innovation.
- Monitor and resolve data quality issues proactively.
Our Tech Stack: Our team leverages the following technologies in our day-to-day development process:
GitHub (CI/CD Flow-GHA), Python, Postgres, AWS (CDK, Lambda, S3, EMR, ECS, SQS, EventBridge, AuroraDB, CloudWatch), Spark, Databricks (SQL, Delta Live Tables, Unity Catalog, Audit Logs, Workflow), Docker/Kubernetes, Airflow, Hive SQL, Terraform, YAML, Helm Charts.
How success is defined
- Build and mentor a high-performing data engineering team, fostering innovation and collaboration.
- Develop scalable, high-performance data pipelines that support R&D initiatives.
- Deliver innovative data solutions in collaboration with researchers, data scientists, and engineers.
- Automate workflows, optimize data reliability, and drive best practices in data security and efficiency.
Required skills and experience
- 2 years managing a team of 5–10 engineers in data engineering or R&D environments.
- 8 years in data engineering, designing and developing scalable data solutions.
- Strong proficiency in Python, Java, or Scala, with advanced SQL skills.
- Experience with big data frameworks (Databricks, Spark, Hive, Iceberg, Kafka, Snowflake).
- Hands-on experience with AWS (S3, Lambda, EMR, ECS, AuroraDB).
- Expertise in distributed data pipelines for batch and real-time processing.
- Proficiency in CI/CD pipelines, DataOps, and Infrastructure as Code (Terraform, YAML, Helm Charts).
- Strong leadership, communication, and cross-functional collaboration skills.
- Experience in data governance, modeling, and quality management for research-driven analytics.
- Healthcare or life sciences data experience is a plus, especially in regulated environments.
Base salary for the role is commensurate with experience and can range between $120,000 - 189,000 annual bonus opportunity.
We prioritize hiring team members from the Philadelphia area whenever possible, as our main office is located in Center City, Philadelphia, where we operate on a hybrid model with in-office work required two days a week. However, for certain roles, we're also open to hiring from our hub locations, where we have groups of remote workers. Please note that, due to tax and labor regulations, we can only hire from specific states, but remote work is supported in the following key hubs and approved states:
Hub Locations:
- Philadelphia, Pennsylvania
- Boston, Massachusetts
- New York City, New York
- Baltimore, Maryland
- Washington D.C.
- Charlotte, North Carolina
- Raleigh-Durham, North Carolina
- Atlanta, Georgia
- Chicago, Illinois
- Compensation: competitive base salary & annual bonus opportunity (for non-commissioned roles)
- Benefits: comprehensive benefits with coverage on Day 1, medical, dental, vision, 401k, stock options
- Flexible location: our HQ is in Philadelphia. We offer both hybrid roles and those with quarterly travel.
- Generous PTO: Take time off as needed, targeted at 4 weeks per year, including vacation, personal and sick time, plus paid parental leave.
- Comprehensive and individualized onboarding: mentorship program, departmental talks, and a library of resources are available beginning day 1 for each new team member to minimize the stress of starting a new job
- Professional development: biweekly 1:1s, hands-on leadership that is goal-and growth-oriented for each team member, and an annual budget to support professional development pursuits
Salary : $120,000 - $189,000
