What are the responsibilities and job description for the Machine Learning Scientist position at Qualified Health?
Transform healthcare with us.
At Qualified Health, we’re redefining what’s possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI governance, healthcare-specific agent creation, and real-time algorithm monitoring—working alongside leading health systems to drive real change.
This is more than just a job. It’s an opportunity to build the future of AI in healthcare, solve complex challenges, and make a lasting impact on patient care. If you’re ambitious, innovative, and ready to move fast, we’d love to have you on board.
Join us in shaping the future of healthcare.
Job Summary:
We're looking for an ML Scientist to join our AI team to join in developing the scientific foundations for our healthcare AI platform. As a scientist at Qualified Health, you’ll be at the cutting edge of applied research on evaluating and improving generative AI applied in a healthcare setting, while also working closely with doctors and other healthcare professionals to ensure the system meets their needs.
In this role, you will develop methodologies to understand and measure the capabilities, limitations, and safety properties of agentic workflows and other generative AI system components. You'll design and implement evaluation frameworks that rigorously assess how well our systems perform a wide variety of healthcare-oriented tasks. And you will use these measures and frameworks to improve the performance of our system.
Key Responsibilities:
- Design and implement evaluation methodologies to measure the reliability, safety, and effectiveness of our AI platform
- Develop novel benchmarks and metrics that capture the nuanced requirements of our adaptive care platform
- Conduct empirical research on the capabilities and limitations of agentic AI workflows in healthcare settings
- Collaborate with our care teams to ensure evaluations are clinically relevant and aligned with patient needs
- Build monitoring systems to detect potential failures or risks in AI-assisted care workflows
- Contribute to the scientific literature on AI evaluation in healthcare through publications and conference presentations
- Work closely with our engineering and product teams to integrate evaluation insights into system development
- Help establish best practices for the safe deployment of agentic systems within our full-stack healthcare system
Required Qualifications:
- PhD or equivalent research experience in machine learning, AI, computer science, or a related field
- Expert-level background in machine learning research, particularly in areas related to language models, reinforcement learning, or AI alignment
- Excellent programming skills, preferably in Python
- Track record of high-quality research publications in venues like NeurIPS, ICML, ACL, ICLR, or similar
- Interest in and enthusiasm for the responsible development of AI technology in healthcare
Desirable Skills:
- Experience working with large language models or foundation models
- Experience designing and implementing evaluation methodologies for complex AI systems
- Background in healthcare informatics, clinical decision support systems, or medical AI
- Prior work on generative AI robustness and evaluation
What we offer:
- Competitive startup salary and equity packages.
- Health, dental, and vision insurance.
- Flexible working hours and hybrid work options.
- An opportunity to be at the forefront of AI in healthcare, making substantial impacts on patient care and outcomes.
- A vibrant and inclusive work environment that fosters creativity and innovation.
Pay & Benefits: The pay range for this role is between $200,000 and $300,000, and will depend on your skills, qualifications, experience, and location. This role is also eligible for equity and benefits.
Join our mission to revolutionize healthcare with AI. To apply, please send your resume through the application below.
Salary : $200,000 - $300,000
