Demo

Software Engineer, LLM

Otter.ai
Mountain View, CA Full Time
POSTED ON 4/9/2025
AVAILABLE BEFORE 5/7/2025
The Opportunity

Our growing company is actively seeking a highly-skilled Large Language Model (LLM) Engineer to join our team. This role will have you directly involved in the design and development of state-of-the-art LLM-based algorithms and systems that power our conversational AI applications. If you possess a passion for pushing the boundaries of LLM technologies and have relevant LLM experience, we would love to connect.

Your Impact

  • Spearhead the design, development and optimization of robust, scalable systems and infrastructure for deploying pioneering algorithms and systems based on large language models.
  • Conduct research and rapidly prototype neural network architectures, training pipelines, inference servers, etc., ensuring we continually stay a step ahead in serving production workloads.
  • Benchmark and profile diverse software/hardware configurations, striving for optimal model performance.
  • Drive implementation of model optimizations for a more scalable and cost effective LLM system.
  • Collaborate closely with our team of research engineers to streamline the transition of machine learning models and algorithms into production.
  • Monitor and incessantly enhance system efficiency, latency, throughput and more.

We're looking for someone who

  • Masters degree 3 years of industry experience or Ph.D. degree in computer science or related field
  • Experience in the construction and optimization of AI/NLP infrastructure and pipelines.
  • Proficiency in Python and experience with frameworks like PyTorch/TensorFlow.
  • Experience working with existing large language models is highly desirable.
  • Superior system design and analytical abilities, with an eye for problem-solving.
  • Demonstrated capacity to deliver in a high-velocity, dynamic environment.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are dedicated to inclusivity.

  • Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $136,000 to $185,000 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.

Salary : $136,000 - $185,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Software Engineer, LLM?

Sign up to receive alerts about other jobs on the Software Engineer, LLM career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$176,149 - $220,529
Income Estimation: 
$77,657 - $95,021
Income Estimation: 
$97,257 - $120,701
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Otter.ai

Otter.ai
Hired Organization Address Mountain View, CA Full Time
The Opportunity We're excited to welcome a talented and passionate Senior Search Engineer to join our highly skilled tea...
Otter.ai
Hired Organization Address Mountain View, CA Full Time
The Opportunity We are looking for a talented Security Engineer with deep systems expertise to join our team. You will p...
Otter.ai
Hired Organization Address New York, NY Full Time
Who we are City Storage Systems develops infrastructure for better food - from building kitchens in cities around the wo...
Otter.ai
Hired Organization Address Los Angeles, CA Full Time
Who we are Otter provides infrastructure and software that enables food operators to open delivery-only locations with m...

Not the job you're looking for? Here are some other Software Engineer, LLM jobs in the Mountain View, CA area that may be a better fit.

Software Engineer, LLM Compilation

OpenReq, Cupertino, CA

Software Engineer, LLM Infrastructure

OpenReq, Cupertino, CA

AI Assistant is available now!

Feel free to start your new journey!