Demo

Principal System Engineer - GenAI / AI Inference

USA Tech Recruit
San Jose, CA Full Time
POSTED ON 3/24/2025 CLOSED ON 4/23/2025

What are the responsibilities and job description for the Principal System Engineer - GenAI / AI Inference position at USA Tech Recruit?

Principal Systems Engineer - GenAI / AI Inference

Our client is a leading edge AI solutions company developing high-performance, low-power AI inference products for various markets. Our mission is to accelerate multimodal AI inference with safe and sustainable solutions. We are a fast-paced, well-funded startup focused on employee well-being and innovative growth.


In this hands-on / technology leadership role, you will be responsible for multi-disciplinary end-to-end system development for our cutting-edge, multimodal generative AI inference products.


You will contribute the creation of new hardware, firmware, middleware and software solutions for our multimodal GenAI products, as well as for its interfaces to partner’s high performance data center frameworks. This is a hands-on role that’s ideal for HPC experts who have a multi-disciplinary engineering background, along with a keen interest in generative AI, and a passion for designing, debugging, optimizing and finding creative system level solutions to complex technical challenges. In this role, you will also frequently advise upon, and maintain system architecture best practices for hardware and software solutions that are built in-house, as well as with strategic technology partners.


What you’ll bring:

  • 15 years of hands-on systems engineering experience, that includes designing, debugging (within both benchtop and HIL testbeds), optimizing and supporting complex software applications that run on custom, programmable hardware systems (like CPUs, GPUs, NPUs, etc.) that heavily leverage high-speed interconnects, high bandwidth memory and cooperative multitasking for distributed computing across many processing elements, deployed within data centers.
  • Demonstrable expertise of Machine/Deep Learning and Kubernetes, with expert programming skills (proficiency with C and Python) along with a deep knowledge of Linux OS/driver/real time software development.
  • Excellent analytical, written, and verbal interpersonal skills along with an ability to productively collaborate within a global engineering team that moves at a startup pace.


We value integrity, excellence, and teamwork. Our culture promotes big thinking, ownership, and the success of our people. Diversity is core to our approach, and we are committed to equal opportunity for all applicants.

AI Inference Software Engineer
Signify Technology -
Sunnyvale, CA
AI Inference Software Engineer
Signify Technology -
Santa Clara, CA
Member of Technical Staff, Research Engineer / Research Scientist (Inference)
Inflection AI -
Stanford, CA

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Principal System Engineer - GenAI / AI Inference?

Sign up to receive alerts about other jobs on the Principal System Engineer - GenAI / AI Inference career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$128,617 - $162,576
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$128,617 - $162,576
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$128,617 - $162,576
Income Estimation: 
$163,289 - $195,234
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$70,609 - $91,165
Income Estimation: 
$86,680 - $110,316
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$86,680 - $110,316
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$117,033 - $148,289
This job has expired.
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at USA Tech Recruit

USA Tech Recruit
Hired Organization Address Sunnyvale, CA Full Time
Staff Software Engineer - Frontend / Backend / Fullstack / Infra / Cloud We're currently on the lookout for multiple Sta...
USA Tech Recruit
Hired Organization Address Mountain View, CA Full Time
We are seeking Staff Software Engineers passionate about creating innovative solutions in the autonomy sector . This rol...
USA Tech Recruit
Hired Organization Address Elkhart, IN Full Time
Customer Success Manager - OEM About Our Client : Our client is committed to becoming a global leader in independent cle...
USA Tech Recruit
Hired Organization Address Detroit, MI Full Time
Project Manager Austin, Tx or Detroit Responsibilities In General 1. Communication with customers and the client’s team ...

Not the job you're looking for? Here are some other Principal System Engineer - GenAI / AI Inference jobs in the San Jose, CA area that may be a better fit.

AI Inference Software Engineer

Signify Technology, San Jose, CA

AI Assistant is available now!

Feel free to start your new journey!