Demo

Machine Learning Engineer

Twelve Labs Inc.
San Francisco, CA Full Time
POSTED ON 3/14/2025 CLOSED ON 3/24/2025

What are the responsibilities and job description for the Machine Learning Engineer position at Twelve Labs Inc.?

Who we are

At Twelve Labs, we are pioneering the development of cutting-edge multimodal foundation models that have the ability to comprehend videos just like humans do. Our models have redefined the standards in video-language modeling, empowering us with more intuitive and far-reaching capabilities, and fundamentally transforming the way we interact with and analyze various forms of media.

With a remarkable $107 million in Seed and Series A funding, our company is backed by top-tier venture capital firms such as NVIDIA’s NVentures, NEA, Radical Ventures, and Index Ventures, and prominent AI visionaries and founders such as Fei-Fei Li, Silvio Savarese, Alexandr Wang and more. Headquartered in San Francisco, with an influential APAC presence in Seoul, our global footprint underscores our commitment to driving worldwide innovation.

We are a global company that values the uniqueness of each person’s journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.

About the role

As a Machine Learning Engineer at Twelve Labs, you will drive our ML systems platform engineering efforts in all facets of our e2e research & engineering workflows. Scaling our training, inference, and evaluation systems — all while improving the reliability of our model deployments / operations / versioning / etc. — is the essence of the role. This role is a perfect fit for engineers who get excited by the prospect of advancing the State of the Art in vision-language modeling by perfecting ML systems and infrastructure!

In this role, you will

Advance our industry-leading enterprise video solutions by incorporating already-great research into fault tolerant, low latency e2e systems

Own model deployment, metadata management, and high-throughput inference strategy for both retrieval ("Marengo") and generative ("Pegasus") models

Mentor junior engineers / researchers, and hold a high bar around code quality / engineering best practices

Build the highest impact, not the flashiest, libraries and services

Lead by example in interviewing, hiring, and onboarding passionate and empathetic engineers

Deliver industry leading applied research solutions to problems like VLM finetuning, auto-labeling of video-text datasets, and model-based filtering of said datasets to optimize (end-)model performance

Work across teams to understand and manage project priorities and product deliverables, evaluate trade-offs, and drive technical initiatives from ideation to execution to shipment

You may be a good fit if you have

7 years of industry experience (or 4 with a PhD in a related technical domain)

A PhD, or a Master's degree, in machine learning or a closely related discipline

Led teams of 3 engineers as a technical lead

Expertise optimizing model inference with TensorRT, ONNX, Triton Inference Server, or directly related technologies

Built Kubernetes-based systems for distributed data / ML workflows or worked extensively with HPC tools such as Slurm

Scaled ML systems and / or data infrastructure to workloads of petabyte scale or have built 0-to-1 mission critical AI / ML applications from scratch

A passion for, and experience in, both ML modeling and ML / AI systems software engineering

Strong Python expertise and considerable prior work history with at least one statically typed language (we use Golang)

Experience with FFmpeg or other high performance image / video processing libraries (bonus points for past work with such processing on GPUs / accelerators)

Acquired, filtered, (re)labeled, or sanitized large scale language or vision-language datasets for LLM / VLM pretraining

Strong communication skills in written and spoken English

Interview and Onboarding Process

1) Recruiter Phone Screen

2) Initial Technical Assessment

3) Final round technical assessment & culture interview

4) Reference Checks

We're also excited to share that we'll do global onboarding in Seoul for all new hires (paid company travel!).

Even if there are a few checkboxes that aren’t ticked through your prior experience, we still encourage you to apply! If you are a 0-to-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at Twelve Labs.

We welcome applicants from all walks of life and are committed to equal-opportunity employment. We cherish and celebrate diversity not just because it is the right thing to do, but because it makes our company much stronger.

Benefits and Perks

An open and inclusive culture and work environment.

Work closely with a collaborative, mission-driven team on cutting-edge AI technology.

Full health, dental, and vision benefits

Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.

Remote-flexible, offices in San Francisco and Seoul and coworking stipend

VISA support (such as H1B and OPT transfer for US employees)

J-18808-Ljbffr

Machine Learning Engineer (Pipeline Developer)
1st. Creative Learning Academy Inc. -
San Rafael, CA
Staff Machine Learning Engineer, Anti-Bots
1st. Creative Learning Academy Inc. -
San Francisco, CA
1st. Creative Learning Academy Inc. is hiring: Machine Learning Engineer (Pipeli
1st. Creative Learning Academy Inc. -
San Rafael, CA

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Engineer?

Sign up to receive alerts about other jobs on the Machine Learning Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$179,606 - $233,815
Income Estimation: 
$211,413 - $298,244
This job has expired.
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Twelve Labs Inc.

Twelve Labs Inc.
Hired Organization Address San Francisco, CA Temporary
Who we are Please double check you have the right level of experience and qualifications by reading the full overview of...
Twelve Labs Inc.
Hired Organization Address San Francisco, CA Full Time
Who we are Below covers everything you need to know about what this opportunity entails, as well as what is expected fro...
Twelve Labs Inc.
Hired Organization Address San Francisco, CA Full Time
Who we are At Twelve Labs, we are pioneering the development of cutting-edge multimodal foundation models that have the ...
Twelve Labs Inc.
Hired Organization Address San Francisco, CA Full Time
Who we are Is this your next job Read the full description below to find out, and do not hesitate to make an application...

Not the job you're looking for? Here are some other Machine Learning Engineer jobs in the San Francisco, CA area that may be a better fit.

Senior Machine Learning Engineer

The Learning Experience #375, San Francisco, CA

Software Engineer, Machine Learning

1st. Creative Learning Academy Inc., San Francisco, CA

AI Assistant is available now!

Feel free to start your new journey!