Demo

Sr. AI/LLM Infrastructure SW Engineer

NIO
Santa Clara, CA Full Time
POSTED ON 1/25/2025
AVAILABLE BEFORE 4/5/2025

About NIO

NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO’s mission is to shape a joyful lifestyle. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.

NIO designs, develops, jointly manufactures and sells premium smart electric vehicles, driving innovations in next-generation technologies in autonomous driving, digital technologies, electric powertrains and batteries. NIO differentiates itself through its continuous technological breakthroughs and innovations, such as its industry-leading battery swapping technologies, Battery as a Service, or BaaS, as well as its proprietary autonomous driving technologies and Autonomous Driving as a Service, or ADaaS.

NIO’s product portfolio consists of the ES8, a six-seater smart electric flagship SUV, the ES7 (or the EL7), a mid-large five-seater smart electric SUV, the ES6, a five-seater all-round smart electric SUV, the EC7, a five-seater smart electric flagship coupe SUV, the EC6, a five-seater smart electric coupe SUV, the ET7, a smart electric flagship sedan, and the ET5, a mid-size smart electric sedan.

Roles and Responsibilities :

  • Architect technical solutions that help us deliver AIOS foundation capability in SkyOS across ECU domains.
  • Lead the proof-of-concept development to evaluate the architectural designs in terms of functionality, performance, security, and dependability.
  • Partner with engineering teams to understand real-world constraints and to support the high-quality implementation of AIOS designs for product development, validation and integration.
  • Define the evolution roadmap for AIOS solutions.
  • Define and deliver requirements for development team.
  • Follow industry trends and study competitors’ technical stacks.

Must Qualifications :

  • 2 years of experience in software design and development for AI model training, and / or inference optimization, and deployment.
  • Familiar with LLM and VLM and optimization on resource constrained edge devices for inferences.
  • In-depth knowledge and hands-on experience in the latest AI model architectures used in the industry and research areas, e.g. Transformer.
  • Solid experience in GPU / NPU architectures and toolchains, AI training frameworks such as PyTorch / TensorFlow / etc.
  • 3 years development experience of building complex software systems.
  • Proficient C / C programming and Python.
  • BS / MS in Electrical Engineering, Computer Engineering, Computer Science or equivalent.
  • Excellent communication skills, and technical writing proficiency.
  • Organized mindset, and passionate about delivering high-quality software.
  • Preferred Qualifications :

  • Masters degree 2 years of relevant industry experience, or Ph.D. degree in computer science, artificial intelligence, or related fields.
  • Familiar with LLM and VLM and optimization on resource constrained edge devices for inferences
  • Experience in performance tuning & inference optimization techniques of deep learning models or libraries on hardware architectures.
  • In-depth knowledge of computer architectures, CPU / MPU, GPU / NPU.
  • Solid understanding of embedded / mobile operating systems.
  • Familiar with microkernel architecture, Linux kernel, hypervisor, middleware, and application framework.
  • Compensation :

    The US base salary range for this full-time position is $143,200.00 - $186,000.00.

  • Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
  • Please note that the compensation details listed in US role postings reflect the base salary only. It does not include discretionary bonus, equity, or benefits.
  • Benefits :

    Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO :

  • CIGNA EPO, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
  • Dental (including orthodontic coverage) and vision plan. Both provide options with a $0 paycheck contribution covering you and your eligible dependents.
  • Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible CIGNA medical plan
  • Healthcare and Dependent Care Flexible Spending Accounts (FSA)
  • 401(k) with Brokerage Link option
  • Company paid Basic Life, AD&D, short-term and long-term disability insurance
  • Employee Assistance Program
  • Sick and Vacation time
  • 13 Paid Holidays a year
  • Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
  • Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
  • Voluntary benefits including : Voluntary Life and AD&D options for you, your spouse / domestic partner and dependent child(ren), pet insurance
  • Commuter benefits
  • Mobile Cell Phone Credit
  • Healthjoy mobile benefit app supporting you and your dependents with benefit questions on the go & support with benefit billing questions
  • Free lunch and snacks
  • Onsite gym
  • Employee discounts and perks program
  • Salary : $143,200 - $186,000

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Sr. AI/LLM Infrastructure SW Engineer?

    Sign up to receive alerts about other jobs on the Sr. AI/LLM Infrastructure SW Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $85,996 - $102,718
    Income Estimation: 
    $111,859 - $131,446
    Income Estimation: 
    $110,457 - $133,106
    Income Estimation: 
    $105,809 - $128,724
    Income Estimation: 
    $122,763 - $145,698
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $145,845 - $177,256
    Income Estimation: 
    $147,836 - $182,130
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $110,220 - $132,692
    Income Estimation: 
    $151,084 - $181,738
    Income Estimation: 
    $133,507 - $160,824
    Income Estimation: 
    $136,663 - $175,160
    Income Estimation: 
    $157,953 - $182,694
    Income Estimation: 
    $77,212 - $88,935
    Income Estimation: 
    $101,213 - $124,848
    Income Estimation: 
    $90,267 - $107,792
    Income Estimation: 
    $90,926 - $113,495
    Income Estimation: 
    $102,148 - $116,687
    Income Estimation: 
    $81,253 - $112,554
    Income Estimation: 
    $89,966 - $112,616
    Income Estimation: 
    $95,407 - $122,738
    Income Estimation: 
    $103,114 - $138,258
    Income Estimation: 
    $86,891 - $130,303
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at NIO

    NIO
    Hired Organization Address San Jose, CA Full Time
    Sr Staff Android Development Engineer JOB DESCRIPTIONAbout NIONIO is a pioneer and a leading company in the premium smar...
    NIO
    Hired Organization Address San Jose, CA Full Time
    Staff / Sr. Staff AI Infra Development Engineer About NIONIO is a pioneer and a leading company in the premium smart ele...
    NIO
    Hired Organization Address Santa Clara, CA Full Time
    Overview : NIO Inc. is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November...

    Not the job you're looking for? Here are some other Sr. AI/LLM Infrastructure SW Engineer jobs in the Santa Clara, CA area that may be a better fit.

    Sr. Machine Learning Engineer, AI Infrastructure

    Tesla Motors, Inc., Palo Alto, CA

    AI Assistant is available now!

    Feel free to start your new journey!