Demo

Distributed Systems Engineer - LLM Platform

Acceler8 Talent
San Mateo, CA Full Time
POSTED ON 1/24/2025
AVAILABLE BEFORE 4/22/2025

Introduction :

As a Distributed Systems Engineer – LLM Platform , you’ll develop scalable systems to deploy and manage large language models. If tackling complex distributed systems challenges and working on advanced AI platforms excites you, this role offers an ideal opportunity.

About the Company :

A leader in AI innovation, this company empowers enterprises to build secure, efficient AI systems. Backed by top-tier VCs, they focus on solving real-world problems in LLM deployment and infrastructure.

About the Role :

You’ll design Kubernetes-based platforms for LLM tuning and inference, manage GPU clusters, and resolve distributed system issues. Collaboration with machine learning engineers and product teams will be central to building cutting-edge AI solutions.

What We Can Offer You

  • Competitive salary : $150,000–$200,000 per year.
  • Work on state-of-the-art AI platforms and infrastructure.
  • A collaborative, fast-paced environment with room for growth.

Key Responsibilities

  • Develop and maintain Kubernetes-based platforms for LLMs.
  • Manage GPU clusters in private data centers.
  • Debug complex distributed systems.
  • Collaborate across teams to deliver scalable enterprise solutions.
  • Keywords : Distributed Systems, Machine Learning, Software Development, GPU, Graphic Processing Unit, Kubernetes, Large Language Models, LLMs, Enterprise Software, Distributed Systems, ML Infra, ML Infrastructure, LLM Inference, LLM tuning, GPU clusters

    Salary : $150,000 - $200,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Distributed Systems Engineer - LLM Platform?

    Sign up to receive alerts about other jobs on the Distributed Systems Engineer - LLM Platform career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $128,617 - $162,576
    Income Estimation: 
    $163,289 - $195,234
    Income Estimation: 
    $117,033 - $148,289
    Income Estimation: 
    $70,609 - $91,165
    Income Estimation: 
    $86,680 - $110,316
    Income Estimation: 
    $117,033 - $148,289
    Income Estimation: 
    $86,680 - $110,316
    Income Estimation: 
    $110,730 - $135,754
    Income Estimation: 
    $117,033 - $148,289
    Income Estimation: 
    $110,730 - $135,754
    Income Estimation: 
    $128,617 - $162,576
    Income Estimation: 
    $117,033 - $148,289
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Acceler8 Talent

    Acceler8 Talent
    Hired Organization Address New York, NY Full Time
    Lead Software Engineer - AI Agents - New York Join a venture-backed AI startup revolutionizing inbound sales through con...
    Acceler8 Talent
    Hired Organization Address Hayward, CA Full Time
    Introduction Are you an engineer who wants to build impactful software for the climate? We’re seeking a Full-Stack Softw...
    Acceler8 Talent
    Hired Organization Address San Jose, CA Full Time
    Introduction : As a Distributed Systems Engineer – LLM Platform , you’ll develop scalable systems to deploy and manage l...
    Acceler8 Talent
    Hired Organization Address Sonoma, CA Full Time
    Talent Headhunter | Help Build a World-Class Team at a Cutting-Edge AI Startup ?? We’re partnering with a trailblazing A...

    Not the job you're looking for? Here are some other Distributed Systems Engineer - LLM Platform jobs in the San Mateo, CA area that may be a better fit.

    Distributed LLM Inference Engineer

    Anyscale, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!