Demo

Founding Software Engineer

Letta
San Francisco, CA Full Time
POSTED ON 2/8/2025
AVAILABLE BEFORE 5/8/2025

Our background

Letta is a company founded around the MemGPT project (13k GitHub stars). The founding team comes from the same research lab and PhD advisors at Berkeley that produced Spark (→ Databricks) and Ray (→ Anyscale). We have deep expertise in both AI and systems, are currently hiring a founding team of exceptional engineers to join us in building the next generation of LLM agent technology.

You can read more about Letta on TechCrunch and our blog.

Your role

Our goal as a company is to empower developers to build state-of-the-art LLM agents to power their own applications. We are looking for someone with expertise in systems and infrastructure (but also with familiarity / interest in LLMs) to help us build a resilient, scaleable, and high-performance platform for deploying and running agents. This role will provide the opportunity to help define what the agents stack will be from a systems perspective.

We are building the developer stack for agents that can run in production applications, not just demo notebooks. As a Software Engineer , you will bridge the gap bleeding-edge agent systems and production-grade software for running agents in real applications. You will help define developer APIs for agents, and lead development of our company's OSS stack as well as the hosted service.

Responsibilities :

  • Design and develop an open-source Agents API standard (an alternative to the OpenAI Assistants API) through the MemGPT OSS project
  • Lead development, deployment, and monitoring of the MemGPT cloud hosted service
  • Ensure high quality code standards through rigorous testing, documentation, and following best practices
  • Maintain clear, up-to-date documentation on both external facing MemGPT developer APIs and internal code

Required skills :

  • At least 4 years of experience
  • Strong proficiency with Python
  • Strong understanding of how to architect services for security, reliability, and performance
  • Ability to design clean, robust REST APIs
  • Ability to architect robust, production-grade services
  • Familiarity with IaC (Terraform) and cloud infrastructure
  • Familiarity with Docker and K8
  • Familiarity with tooling across the AI stack, such as inference engines (e.g. vLLM, Ollama), vector DBs (e.g. Chroma, pgvector), and RAG (e.g. llama-index, langchain)
  • Bonus : proficient with TypeScript, React, Tailwind, etc. (the modern stack for web applications)
  • Our hiring process

    We are hiring a small, tight-knit team of exceptionally talented founding engineers. Every hire matters, so we take the hiring process very seriously.

  • Initial phone interview (30m video call) : We want to learn more about your background, your skills, your opinions on open source AI, and why you want to work at an early stage AI startup.
  • Technical take-home (
  • Paid workday (in-person recommended) : As the final step in the interview process, we'll simulate working together as closely as possible by giving you a real (or as close to real as possible) task to work on for a day - and paying for your time of course. If you live in the Bay Area, we highly recommend visiting our offices in-person! We're an in-person company, so working at our office will give you a great idea of what it will be like to join as a full-time member of the team.
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Founding Software Engineer?

    Sign up to receive alerts about other jobs on the Founding Software Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $88,984 - $115,784
    Income Estimation: 
    $111,369 - $141,168
    Income Estimation: 
    $117,871 - $153,580
    Income Estimation: 
    $109,939 - $144,341
    Income Estimation: 
    $114,500 - $144,633
    Income Estimation: 
    $97,257 - $120,701
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $123,167 - $152,295
    Income Estimation: 
    $146,673 - $180,130
    Income Estimation: 
    $111,369 - $141,168
    Income Estimation: 
    $131,745 - $167,716
    Income Estimation: 
    $144,503 - $184,592
    Income Estimation: 
    $102,541 - $137,871
    Income Estimation: 
    $153,752 - $200,235
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Letta

    Letta
    Hired Organization Address San Francisco, CA Full Time
    Our background Letta is a company founded around the MemGPT project (13k GitHub stars). The founding team comes from the...
    Letta
    Hired Organization Address San Francisco, CA Full Time
    Our background Letta is a company founded around the MemGPT project (13k GitHub stars). The founding team comes from the...

    Not the job you're looking for? Here are some other Founding Software Engineer jobs in the San Francisco, CA area that may be a better fit.

    Founding Software Engineer

    Bronco, San Francisco, CA

    Founding Senior Software Engineer

    Recruiting From Scratch, San Francisco, CA

    AI Assistant is available now!

    Feel free to start your new journey!