Demo

Senior Machine Learning Engineer - LLM

Moveworks.ai
Mountain View, CA Full Time
POSTED ON 3/9/2025
AVAILABLE BEFORE 6/8/2025

What You Will Do

We are looking for a Machine Learning Engineer to help build cutting edge ML infrastructure for building and serving LLM's at Moveworks. This role will be critical in building, optimizing and scaling end-to-end machine learning systems. The ML infra team covers a variety of responsibilities including distributed training and inference pipeline for large language models(LLM), model evaluation and monitoring framework, LLM latency optimization, etc. These frameworks serve as a strong foundation for our hundreds of ML and NLP models in production serving hundreds of millions of enterprise employees. We are solving many challenges on scalability of services as well as optimization of core algorithms.

In this role you will work closely with our machine learning team, data infrastructure team and every core skill. Above all, your work will impact the way our customers experience AI. Put another way, this role is absolutely critical to the long term scalability of our core AI product and ultimately the company. You will be responsible for building and productionizing ML infrastructure that runs state of the art models. If you are looking for a high-impact, fast-moving role to take your work to the next level, we should have a conversation.

  • Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
  • Build abstractions to automate various steps in different ML workflows
  • Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
  • Leverage your experience to drive best practices in ML and data engineering

What You Bring To The Table

  • 2 years of industry experience in Machine Learning, Infrastructure or related fields
  • Experience with deep learning framework such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
  • Experience with building and scaling end-to-end machine learning systems
  • Experience building scalable micro services and ETL pipelines
  • Expertise in Python and experience with performant language such as C or GoLang
  • Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field.
  • A love of research publications in the machine learning and software engineering communities
  • Effective communicator with experience collaborating cross-functionally with other teams
  • Nice To Haves

  • Experience with ML Inference optimization using TensorRT.
  • Experience with distributed training frameworks such as Deepspeed.
  • Experience in managing and scaling GPU Inference services via Kubernetes
  • Base salary compensation range : $129,000 - $257,000

  • Our compensation package includes a market competitive salary, equity for all full time roles, exceptional benefits, and, for applicable roles, commissions or bonus plans.
  • Ultimately, in determining pay, final offers may vary from the amount listed based on geography, the role's scope and complexity, the candidate's experience and expertise, and other factors.

    Moveworks Is An Equal Opportunity Employer

  • Moveworks is proud to be an equal opportunity employer. We provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, veteran status, or any other characteristics protected by law.
  • Who We Are

    Moveworks is the universal AI copilot for search and automation across all your business applications. We give employees one place to go to find information and get support while reducing costs for your business. The Moveworks Copilot is powered by an industry-leading Reasoning Engine that uses a combination of public and proprietary language models to understand employee queries, then build and execute multi-step plans that achieve them. It does this by linking into systems (like ITSM, HRIS, ERP, identity management, and more) with native and custom-built integrations that turn natural language into powerful automations for employees.

    The world's most innovative brands like Databricks, Broadcom, Hearst, and Palo Alto Networks trust Moveworks to eliminate repetitive support issues, deliver instant knowledge, and empower employees to work faster across applications.

    Founded in 2016, Moveworks has raised $315 million in funding, at a valuation of $2.1 billion, thanks to our award-winning product and team. In 2023, we were included in the Forbes Cloud 100 list as well as the Forbes AI 50 for the fifth consecutive year. We were also recognized by the 2023 Edison Awards for AI Optimized Productivity, and were included on Fast Company's Most Innovative Companies list for 2024!

    Moveworks has over 500 employees in six offices around the world, and is backed by some of the world's most prominent investors, including Kleiner Perkins, Lightspeed, Bain Capital Ventures, Sapphire Ventures, Iconiq, and more.

    Come join one of the most innovative teams on the planet!

    Salary : $129,000 - $257,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Senior Machine Learning Engineer - LLM?

    Sign up to receive alerts about other jobs on the Senior Machine Learning Engineer - LLM career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $184,796 - $233,226
    Income Estimation: 
    $77,900 - $95,589
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $119,030 - $151,900
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Moveworks.ai

    Moveworks.ai
    Hired Organization Address Mountain View, CA Full Time
    Content Summary : Senior Visual Designer (Contract) at Mountain View, for Moveworks.ai What You Will Do As a key member ...
    Moveworks.ai
    Hired Organization Address Mountain View, CA Full Time
    Content Summary : Senior Visual Designer (Contract) at Mountain View, for Moveworks.ai What You Will Do As a key member ...
    Moveworks.ai
    Hired Organization Address Mountain View, CA Full Time
    Location : Mountain View, CA (In Office ~3 days a week) What You Will Do Be at the forefront with our Demand Gen team! O...
    Moveworks.ai
    Hired Organization Address Austin, TX Full Time
    SDR Austin, TX Full Time This is a hybrid role and requires 3 days a week in person in Austin, TX What You Will Do As a ...

    Not the job you're looking for? Here are some other Senior Machine Learning Engineer - LLM jobs in the Mountain View, CA area that may be a better fit.

    Machine Learning Engineer - LLM

    Moveworks.ai, Mountain View, CA

    Machine Learning Engineer- LLM

    Apple, Cupertino, CA

    AI Assistant is available now!

    Feel free to start your new journey!