Demo

Software Engineer for Large Language Model Platform

Acceler8 Talent
San Francisco, CA Full Time
POSTED ON 1/16/2025
AVAILABLE BEFORE 4/13/2025

Software Engineer for Large Language Model Platform

Join a leading AI solutions company as a skilled Software Engineer for Large Language Model Platform and be part of an innovative R&D team. This is an incredible opportunity to work on revolutionary large language model (LLM) technologies that empower enterprise customers, and if you are eager to develop scalable and reliable systems, this role may be your ideal next step.

This organization is committed to equipping enterprises with the means to create their own Expert AI. With a focus on enterprise-level security, flexibility, and minimizing hallucination, their platform enables customers to train and deploy tailored models using their own data. The team consists of dedicated engineers and researchers working with impactful technologies, backed by leading VCs and tech companies. As a Software Engineer for Large Language Model Platform , you will play an essential role in the development and upkeep of these advanced AI systems.

In this position, you will be tasked with design, implementation, and maintenance of LLM platforms that operate on Kubernetes. You will tackle intricate distributed systems, resolve challenging issues across Kubernetes clusters, and ensure the seamless operation of customer-facing systems. This hands-on role requires strong technical skills combined with a proactive approach. You will also work closely with cross-functional teams, including ML engineers, application developers, and product managers to create high-quality platform features.

What We Offer You :

  • Equity and comprehensive benefits package.
  • Opportunity to collaborate with top engineers on groundbreaking AI platforms.
  • A supportive and inclusive team environment.
  • Access to cutting-edge infrastructure and tools.
  • A fast-paced, mission-driven culture centered around innovation and impact.

Key Responsibilities :

  • Design, implement, and maintain an LLM platform on Kubernetes, supporting LLM tuning and inference workloads.
  • Troubleshoot complex distributed system issues across Kubernetes environments, often with limited access.
  • Respond quickly and effectively to customer inquiries, ensuring high satisfaction levels.
  • Manage internal GPU resources and optimize cluster performance in the data center.
  • Collaborate with engineering and product teams to define and implement platform functionalities.
  • Create clear and concise documentation to assist customers in utilizing the product effectively.
  • The ideal candidate will possess strong proficiency in Python (or similar programming languages) and familiarity with Kubernetes , distributed systems , and machine learning workflows . Experience with LLM training , inference , and RAG systems will be beneficial. We welcome candidates with experience building or contributing to platforms for large-scale AI applications. A solid understanding of open-source tools , GPU management , and CI / CD pipelines will be invaluable in succeeding in this role.

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Software Engineer for Large Language Model Platform?

    Sign up to receive alerts about other jobs on the Software Engineer for Large Language Model Platform career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $176,149 - $220,529
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $77,657 - $95,021
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Acceler8 Talent

    Acceler8 Talent
    Hired Organization Address San Francisco, CA Full Time
    Senior Software Engineer (AI Infrastructure / MLOps) Location: San Francisco (3 days per week in office) Introduction: W...
    Acceler8 Talent
    Hired Organization Address Bay, FL Full Time
    Skill Requirements Strong expertise in post-training techniques and large language models Solid foundation in machine le...
    Acceler8 Talent
    Hired Organization Address Palo Alto, CA Full Time
    Envisioning AI for All Democratizing AI accessibility is our commitment, making it an affordable and efficient tool for ...
    Acceler8 Talent
    Hired Organization Address Palo Alto, CA Full Time
    Shape the Future of Conversational AI About Us We are a public benefit corporation dedicated to harnessing advanced larg...

    Not the job you're looking for? Here are some other Software Engineer for Large Language Model Platform jobs in the San Francisco, CA area that may be a better fit.

    Senior+ Software Engineer (Large Language Models)

    2txt - natural language generation GmbH, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!