Demo

Software Engineer, AI Infrastructure (Training + Inference)

Waveforms AI, Inc
San Francisco, CA Full Time
POSTED ON 2/12/2025
AVAILABLE BEFORE 5/7/2025

Job title : Software Engineer, AI Infrastructure (Training Inference) / Member of Technical Staff

Who We Are WaveForms AI is an Audio Large Language Models (LLMs) company building the future of audio intelligence through advanced research and products. Our models will transform human-AI interactions making them more natural, engaging and immersive.

Role overview : The Software Engineer, AI Infrastructure (Training Inference) will be responsible for designing, building, and optimizing the infrastructure that powers our large scale training and real-time inference pipelines. This role combines expertise in distributed computing, system reliability, and performance optimization. The candidate will collaborate with researchers with a focus on building scalable systems to support novel multimodal training and maintaining uptime to deliver consistent results for real-time applications.

Key Responsibilities

  • Infrastructure Development : Design and implement infrastructure to support large-scale AI training and real-time inference with a focus on multimodal inputs.
  • Distributed Computing : Build and maintain distributed systems to ensure scalability, efficient resource allocation, and high throughput.
  • Training Stability : Monitor and enhance the stability of training workflows by addressing bottlenecks, failures, and inefficiencies in large-scale AI pipelines.
  • Real-time Inference Optimization : Develop and optimize real-time inference systems to deliver low-latency, high-throughput results across diverse applications.
  • Uptime & Reliability : Implement tools and processes to maintain high uptime and ensure infrastructure reliability during both training and inference phases.
  • Performance Tuning : Identify and resolve performance bottlenecks, improving overall system throughput and response times.
  • Collaboration : Work closely with research and engineering teams to integrate infrastructure with AI workflows, ensuring seamless deployment and operation.

Required Skills & Qualifications

  • Distributed Systems Expertise : Proven experience in designing and managing distributed systems for large-scale AI training and inference.
  • Infrastructure for AI : Strong background in building and optimizing infrastructure for real-time AI systems, with a focus on multimodal data (audio text).
  • Performance Optimization : Expertise in optimizing resource utilization, improving system throughput, and reducing latency in both training and inference.
  • Training Stability : Experience in troubleshooting and stabilizing AI training pipelines for high reliability and efficiency.
  • Technical Proficiency : Strong programming skills (Python preferred), proficiency with PyTorch, and familiarity with cloud platforms (AWS, GCP, Azure).
  • Minimum Experience

  • 4-5 years of relevant professional experience is required
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Software Engineer, AI Infrastructure (Training + Inference)?

    Sign up to receive alerts about other jobs on the Software Engineer, AI Infrastructure (Training + Inference) career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $176,149 - $220,529
    Income Estimation: 
    $77,657 - $95,021
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Waveforms AI, Inc

    Waveforms AI, Inc
    Hired Organization Address San Francisco, CA Full Time
    Full Stack Software Engineer Who We Are WaveForms AI is an Audio LLM company redefining how humans interact with AI-maki...
    Waveforms AI, Inc
    Hired Organization Address San Francisco, CA Full Time
    Job title : Software Engineer, LLM Inference Engine and Product / Member of Technical Staff Who We Are WaveForms AI is a...

    Not the job you're looking for? Here are some other Software Engineer, AI Infrastructure (Training + Inference) jobs in the San Francisco, CA area that may be a better fit.

    Staff Software Engineer - Infrastructure

    Snorkel AI, San Francisco, CA

    Senior Software Engineer - Infrastructure

    Snorkel AI, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!