Demo

MLOps Engineer

Otter.ai
Mountain View, CA Full Time
POSTED ON 4/3/2025
AVAILABLE BEFORE 5/10/2025
The Opportunity

Are you an experienced MLOps Engineer passionate about building robust, scalable, and efficient machine learning infrastructure? Do you thrive in a fast-paced AI research environment, empowering the team by building and maintaining infrastructure for both cutting-edge model training and production deployment? If so, this role is for you!

As an MLOps Engineer on our AI Research team, you will build and manage the infrastructure for both training and deploying AI models, ensuring scalability, reliability, and performance. You will work closely with researchers, ML engineers, and software developers to ensure seamless integration and optimization of machine learning workflows. Your contributions will empower our AI models to perform efficiently in real-world applications at scale.

Your Impact

  • Infrastructure & System Administration: Design, deploy, and maintain scalable infrastructure on Linux, Kubernetes, and AWS to support machine learning workloads.
  • CI/CD & GitOps: Develop and manage automated CI/CD pipelines for machine learning models and applications, ensuring seamless deployments and version control.
  • Internal Tooling: Build internal web applications to improve ML workflow efficiency, model monitoring, and deployment processes.
  • Experiment Tracking & Model Management: Utilize tools such as Weights & Biases, MLflow, and other experiment tracking systems to manage model lifecycle and metadata.
  • Production Inference Optimization: Deploy and optimize ML models for inference using ONNX, TorchScript, TensorRT, or other relevant technologies to maximize performance.
  • Performance Tuning: Conduct performance profiling and tuning of ML workloads, optimizing memory usage, compute efficiency, and model latency.
  • Scalable Data Processing: Design and maintain large-scale data processing pipelines using Spark, Ray, or other distributed computing frameworks to support AI research and production systems.

We're Looking For Someone Who

  • Has a Master’s degree 3 years of industry experience or a Ph.D. in computer science, machine learning, or a related field.
  • Has hands-on experience with Linux system administration, Kubernetes, Terraform, and AWS.
  • Is proficient in GitOps, CI/CD tools (e.g., ArgoCD, Jenkins, GitHub Actions).
  • Has experience in writing internal web applications (e.g., using Django, Flask, FastAPI, or React).
  • Is familiar with ML experiment tracking tools (e.g., Weights & Biases, MLflow).
  • Has expertise in model deployment and inference optimization using ONNX, TorchScript, TensorRT, or similar frameworks.
  • Has strong programming skills in Python, with additional experience in Rust or C .
  • Understands large-scale distributed computing and has worked with Spark, Ray, or other big data processing frameworks.
  • Has experience with performance tuning of ML models and infrastructure.
  • Is comfortable collaborating with research and engineering teams to translate cutting-edge AI into scalable, production-ready solutions.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are dedicated to inclusivity.

  • Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $155,000 to $185,000 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.

Salary : $155,000 - $185,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a MLOps Engineer?

Sign up to receive alerts about other jobs on the MLOps Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$117,024 - $149,811
Income Estimation: 
$137,568 - $176,908
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Otter.ai

Otter.ai
Hired Organization Address New York, NY Full Time
Who we are City Storage Systems develops infrastructure for better food - from building kitchens in cities around the wo...
Otter.ai
Hired Organization Address Los Angeles, CA Full Time
Who we are Otter provides infrastructure and software that enables food operators to open delivery-only locations with m...
Otter.ai
Hired Organization Address Mountain View, CA Full Time
The Opportunity We are seeking a highly skilled and experienced Software Engineer, iOS to take full ownership of develop...
Otter.ai
Hired Organization Address San Francisco, CA Full Time
Join us on our quest to make conversations more valuable!At Otter, we're fueled by the unwavering teamwork and dedicatio...

Not the job you're looking for? Here are some other MLOps Engineer jobs in the Mountain View, CA area that may be a better fit.

MLOps Engineer

DynPro Inc., Sunnyvale, CA

MLOps Engineer

DynPro Inc., Fremont, CA

AI Assistant is available now!

Feel free to start your new journey!