Demo

Software Engineer, AI Infrastructure (Training + Inference)

Waveforms
San Francisco, CA Full Time
POSTED ON 1/15/2025
AVAILABLE BEFORE 4/7/2025

Job title : Software Engineer, AI Infrastructure (Training Inference) / Member of Technical Staff

Who We Are

WaveForms AI is an Audio Large Language Models (LLMs) company building the future of audio intelligence through advanced research and products. Our models will transform human-AI interactions making them more natural, engaging and immersive.

Role overview : The Software Engineer, AI Infrastructure (Training Inference) will be responsible for designing, building, and optimizing the infrastructure that powers our large scale training and real-time inference pipelines. This role combines expertise in distributed computing, system reliability, and performance optimization. The candidate will collaborate with researchers with a focus on building scalable systems to support novel multimodal training and maintaining uptime to deliver consistent results for real-time applications.

Key Responsibilities

Infrastructure Development : Design and implement infrastructure to support large-scale AI training and real-time inference with a focus on multimodal inputs..

Distributed Computing : Build and maintain distributed systems to ensure scalability, efficient resource allocation, and high throughput.

Training Stability : Monitor and enhance the stability of training workflows by addressing bottlenecks, failures, and inefficiencies in large-scale AI pipelines.

Real-time Inference Optimization : Develop and optimize real-time inference systems to deliver low-latency, high-throughput results across diverse applications.

Uptime & Reliability : Implement tools and processes to maintain high uptime and ensure infrastructure reliability during both training and inference phases.

Performance Tuning : Identify and resolve performance bottlenecks, improving overall system throughput and response times.

Collaboration : Work closely with research and engineering teams to integrate infrastructure with AI workflows, ensuring seamless deployment and operation.

Required Skills & Qualifications

Distributed Systems Expertise : Proven experience in designing and managing distributed systems for large-scale AI training and inference.

Infrastructure for AI : Strong background in building and optimizing infrastructure for real-time AI systems, with a focus on multimodal data (audio text).

Performance Optimization : Expertise in optimizing resource utilization, improving system throughput, and reducing latency in both training and inference.

Training Stability : Experience in troubleshooting and stabilizing AI training pipelines for high reliability and efficiency.

Technical Proficiency : Strong programming skills (Python preferred), proficiency with PyTorch, and familiarity with cloud platforms (AWS, GCP, Azure).

J-18808-Ljbffr

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Software Engineer, AI Infrastructure (Training + Inference)?

Sign up to receive alerts about other jobs on the Software Engineer, AI Infrastructure (Training + Inference) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$176,149 - $220,529
Income Estimation: 
$77,657 - $95,021
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Waveforms

Waveforms
Hired Organization Address San Francisco, CA Full Time
Job title : Software Engineer, LLM Inference Engine and Product / Member of Technical Staff Who We Are WaveForms AI is a...
Waveforms
Hired Organization Address San Francisco, CA Full Time
Job title : Research Engineer (Pre-training & Post-training) / Member of Technical Staff Who We Are You can get further ...

Not the job you're looking for? Here are some other Software Engineer, AI Infrastructure (Training + Inference) jobs in the San Francisco, CA area that may be a better fit.

Staff Software Engineer, Data Infrastructure

Scale AI, San Francisco, CA

Senior Software Engineer, Infrastructure

Hayden AI Technologies, Inc, San Francisco, CA

AI Assistant is available now!

Feel free to start your new journey!