What are the responsibilities and job description for the Principal System Engineer - GenAI / AI Inference position at USA Tech Recruit?
Principal Systems Engineer - GenAI / AI Inference
Our client is a leading edge AI solutions company developing high-performance, low-power AI inference products for various markets. Our mission is to accelerate multimodal AI inference with safe and sustainable solutions. We are a fast-paced, well-funded startup focused on employee well-being and innovative growth.
In this hands-on / technology leadership role, you will be responsible for multi-disciplinary end-to-end system development for our cutting-edge, multimodal generative AI inference products.
You will contribute the creation of new hardware, firmware, middleware and software solutions for our multimodal GenAI products, as well as for its interfaces to partner’s high performance data center frameworks. This is a hands-on role that’s ideal for HPC experts who have a multi-disciplinary engineering background, along with a keen interest in generative AI, and a passion for designing, debugging, optimizing and finding creative system level solutions to complex technical challenges. In this role, you will also frequently advise upon, and maintain system architecture best practices for hardware and software solutions that are built in-house, as well as with strategic technology partners.
What you’ll bring:
- 15 years of hands-on systems engineering experience, that includes designing, debugging (within both benchtop and HIL testbeds), optimizing and supporting complex software applications that run on custom, programmable hardware systems (like CPUs, GPUs, NPUs, etc.) that heavily leverage high-speed interconnects, high bandwidth memory and cooperative multitasking for distributed computing across many processing elements, deployed within data centers.
- Demonstrable expertise of Machine/Deep Learning and Kubernetes, with expert programming skills (proficiency with C and Python) along with a deep knowledge of Linux OS/driver/real time software development.
- Excellent analytical, written, and verbal interpersonal skills along with an ability to productively collaborate within a global engineering team that moves at a startup pace.
We value integrity, excellence, and teamwork. Our culture promotes big thinking, ownership, and the success of our people. Diversity is core to our approach, and we are committed to equal opportunity for all applicants.