Demo

Site Reliability Engineer, AI Infrastructure

Tesla
Stanford, CA Full Time
POSTED ON 3/3/2025
AVAILABLE BEFORE 5/24/2025

Tesla's Supercomputing / AI infrastructure team works directly with the high-performance computing and machine learning infrastructure on which our ML algorithms run; this includes virtual simulations, Autopilot hardware, silicon design, and Dojo. With the rapidly-growing need for more data and optimized compute resources, cluster builds are getting larger and increasingly complex. Continued development / automation of deployment, monitoring, self-healing and alerting processes is imperative to the success of our engineering groups. As the scope and impact of our Optimus, Full-Self-Driving (FSD) & Robotaxi efforts continue to scale, so does the value of this team and its work.

As a Site Reliability Engineer, you will be responsible for maintaining and improving our platform to ensure our Full-Self-Driving (FSD), Optimus & Dojo engineering teams have the necessary tools and resources to be productive. This includes managing / operating our AI infrastructure, monitoring compute / GPU / network metrics, Linux troubleshooting & performance tuning, and security. Your work will directly facilitate neural network training at scale, streamline FSD development, and enable Dojo to become the most powerful supercomputer to date.

Responsibilities

  • Support the AI / ML cluster infrastructure on both GPU and Dojo platforms, focusing on systems automation, configuration management and deployment at scale
  • Improve our monitoring & self-healing pipelines, as well as security posture
  • Optimize our server, storage and network performance
  • Develop new tools in Python, Golang or Bash / Shell
  • Use Infrastructure as Code best practices
  • Participate in 24x7 on-call rotation

Requirements

  • Proficiency in Python, Golang and / or Bash
  • Proficiency with Linux fundamentals and performance optimizations
  • Experience with configuration management software (Ansible, etc.), systems monitoring & alerting (Prometheus, Grafana, Telegraf, Splunk, etc.)
  • Experience with containerization technologies such as Kubernetes
  • Experience with high-throughput low-latency networks, GPU-based computing systems, and / or high-performance storage systems is a plus
  • Experience with Slurm, LSF and storage management of parallel file systems is a plus
  • Bachelor's Degree in Computer Science, Computer Engineering, Electrical Engineering, Physics or proof of exceptional skills in related field
  • 3 years of additional equivalent experience or evidence of exceptional ability related to the position
  • Compensation and Benefits

    Benefits

    Along with competitive pay, as a full-time Tesla employee, you are eligible for the following benefits at day 1 of hire :

  • Aetna PPO and HSA plans >
  • 2 medical plan options with $0 payroll deduction

  • Family-building, fertility, adoption and surrogacy benefits
  • Dental (including orthodontic coverage) and vision plans, both have options with a $0 paycheck contribution
  • Company Paid (Health Savings Account) HSA Contribution when enrolled in the High Deductible Aetna medical plan with HSA
  • Healthcare and Dependent Care Flexible Spending Accounts (FSA)
  • 401(k) with employer match, Employee Stock Purchase Plans, and other financial benefits
  • Company paid Basic Life, AD&D, short-term and long-term disability insurance
  • Employee Assistance Program
  • Sick and Vacation time (Flex time for salary positions), and Paid Holidays
  • Back-up childcare and parenting support resources
  • Voluntary benefits to include : critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insurance
  • Weight Loss and Tobacco Cessation Programs
  • Tesla Babies program
  • Commuter benefits
  • Employee discounts and perks program
  • Expected Compensation

    133,440 - $355,920 / annual salary cash and stock awards benefits

    Pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

    Salary : $133,440 - $355,920

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Site Reliability Engineer, AI Infrastructure?

    Sign up to receive alerts about other jobs on the Site Reliability Engineer, AI Infrastructure career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $82,762 - $100,977
    Income Estimation: 
    $95,852 - $118,073
    Income Estimation: 
    $120,143 - $165,703
    Income Estimation: 
    $76,670 - $90,826
    Income Estimation: 
    $91,609 - $118,978
    Income Estimation: 
    $92,877 - $110,401
    Income Estimation: 
    $92,877 - $110,401
    Income Estimation: 
    $120,933 - $155,034
    Income Estimation: 
    $114,618 - $136,401
    Income Estimation: 
    $114,618 - $136,401
    Income Estimation: 
    $144,264 - $191,312
    Income Estimation: 
    $140,435 - $166,410
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Tesla

    Tesla
    Hired Organization Address Sparks, NV Full Time
    A Cell Recycling Universal Waste Technician at Gigafactory 1 is responsible for material movement and support to the Cel...
    Tesla
    Hired Organization Address Sparks, NV Full Time
    Tesla's Cell Infrastructure team is looking for an experienced Commissioning Lead to oversee commissioning and startup a...
    Tesla
    Hired Organization Address Sparks, NV Full Time
    Tesla is looking for a highly motivated Project Material Flow Data Engineer to lead the development and implementation o...
    Tesla
    Hired Organization Address Henderson, NV Full Time
    Powerwall Technical Support is a customer-facing support team that offers product education and technical solutions to c...

    Not the job you're looking for? Here are some other Site Reliability Engineer, AI Infrastructure jobs in the Stanford, CA area that may be a better fit.

    AI Assistant is available now!

    Feel free to start your new journey!