Demo

Principal Machine Learning Engineer - LLMOps

ZoomInfo Technologies LLC
Waltham, MA Full Time
POSTED ON 2/27/2025
AVAILABLE BEFORE 5/24/2025

At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We value your take charge, take initiative, get stuff done attitude and will help you unlock your growth potential. One great choice can change everything. Thrive with us at ZoomInfo.

About Us :

We're building the next generation of AI-powered B2B solutions at scale. Our team is at the forefront of deploying large language models (LLMs) and knowledge graphs to transform how businesses access and use information. We work closely with product, engineering, and ML teams to bring cutting-edge AI capabilities to production.

What You'll Do :

  • Design and build a scalable LLMOps platform to support multiple production AI applications
  • Create and implement evaluation frameworks and guardrails for LLM deployments
  • Fine-tune embedding models and pre-train LLMs for specific business use cases
  • Develop proof-of-concepts for new AI technologies and compare them with existing approaches
  • Build and optimize knowledge graphs for search and recommendation systems
  • Work with ML teams to enable new AI capabilities across our product suite
  • Share knowledge and mentor team members on best practices in AI engineering

What You Bring :

  • 5 years of experience in machine learning engineering or AI infrastructure
  • Strong background in deploying open-source LLMs in production environments
  • Hands-on experience with model fine-tuning and embedding models
  • Expertise in RAG (Retrieval Augmented Generation) and vector databases
  • Knowledge of LLM evaluation methods and governance
  • Experience with tools like Hugging Face and modern ML frameworks
  • Background in Computer Science, Electrical Engineering, or related field (Masters / PhD preferred)
  • Ideal Experience :

  • Built and scaled AI systems at companies with strong technical cultures
  • Worked on knowledge graphs, search, or recommendation systems
  • Experience with B2B or B2C products using AI at scale
  • Why You'll Love It Here :

  • Work on cutting-edge AI technology that directly impacts business outcomes
  • End-to-end ownership of features from concept to production
  • Collaborative team environment focused on learning and mentorship
  • Opportunity to publish and share work with the broader AI community
  • Build next-generation AI capabilities used by leading global companies
  • We're looking for curious minds who love solving complex problems and want to shape the future of AI in enterprise software. If you're excited about building reliable, scalable AI systems that deliver real business value, we want to talk to you!

    Location : Remote / USA

    Type : Full-time

    Actual compensation offered will be based on factors such as the candidate's work location, qualifications, skills, experience and / or training. Your recruiter can share more information about the specific salary range for your desired work location during the hiring process. We want our employees and their families to thrive.

    In addition to comprehensive benefits we offer holistic mind, body and lifestyle programs designed for overall well-being. Learn more about ZoomInfo benefits here.

    Below is the US base salary for this position. Additional compensation such as Bonus, Commission, Equity and other benefits may also apply.

    212,000-$291,500 USD

    About us :

    ZoomInfo (NASDAQ : ZI) is the trusted go-to-market platform for businesses to find, acquire, and grow their customers. It delivers accurate, real-time data, insights, and technology to more than 35,000 companies worldwide. Businesses use ZoomInfo to increase efficiency, consolidate technology stacks, and align their sales and marketing teams - all in one platform.

    ZoomInfo may use a software-based assessment as part of the recruitment process. More information about this tool, including the results of the most recent bias audit, is available here.

    ZoomInfo is proud to be an Equal Opportunity Employer. We are committed to equal employment opportunities for applicants and employees regardless of sex, race, age, color, national origin, sexual orientation, gender identity, marital status, disability status, religion, protected military or veteran status, medical condition, or any other characteristic or status protected by applicable law. At ZoomInfo, we also consider qualified candidates with criminal histories, consistent with legal requirements.

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Principal Machine Learning Engineer - LLMOps?

    Sign up to receive alerts about other jobs on the Principal Machine Learning Engineer - LLMOps career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $184,796 - $233,226
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $184,796 - $233,226
    Income Estimation: 
    $184,796 - $233,226
    Income Estimation: 
    $179,606 - $233,815
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at ZoomInfo Technologies LLC

    ZoomInfo Technologies LLC
    Hired Organization Address Bethesda, MD Full Time
    At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We v...
    ZoomInfo Technologies LLC
    Hired Organization Address Vancouver, WA Full Time
    At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We v...
    ZoomInfo Technologies LLC
    Hired Organization Address Waltham, MA Full Time
    At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We v...
    ZoomInfo Technologies LLC
    Hired Organization Address Waltham, MA Full Time
    At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We v...

    Not the job you're looking for? Here are some other Principal Machine Learning Engineer - LLMOps jobs in the Waltham, MA area that may be a better fit.

    Principal Engineer, Machine Learning

    Tessera Therapeutics, Somerville, MA

    AI Assistant is available now!

    Feel free to start your new journey!