Demo

GPU Kernel Engineer

MakoAvance Consulting
New York, NY Full Time
POSTED ON 2/12/2025
AVAILABLE BEFORE 5/11/2025

Company Brief :

We are a venture-backed tech startup building software infrastructure for high performance AI inference and training on any hardware. There are three core components :

1. Our Compiler automatically selects, tunes, and generates GPU kernels for any hardware platform

2. Our Runtime serves compiled models at high performance

3. Our Platform enables users to easily deploy and manage deployments across any cloud (you’ll be working on this!)

Job Description / Key Responsibilities :

  • Explore and analyze performance bottlenecks in ML training and inference.
  • Develop and optimize high-performance computing kernels in Triton, CUDA, and / or ROCm.
  • Implement programming solutions in C / C and Python.
  • Deep dive into GPU performance optimizations to maximize efficiency and speed.
  • Collaborate with the team to extend and improve existing machine learning compilers or frameworks such as MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT. (This is optional but beneficial)

Qualifications

  • Bachelor's, Master’s or PhD’s degree in Computer Science, Electrical Engineering, or a related field.
  • Strong programming skills in C / C and Python.
  • Deep understanding and experience in GPU performance optimizations.
  • Proven experience with kernel optimizations on CUDA, ROCm, or otheraccelerators.
  • General experience with the training and deployment of ML models
  • Experience with distributed systems development or distributed ML workloads
  • Bonus

  • Experience with innovative OSS projects like FlashAttention, mlc-llm, vllm.
  • Experience with machine learning compilers or frameworks such as TVM, MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT.
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a GPU Kernel Engineer?

    Sign up to receive alerts about other jobs on the GPU Kernel Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $71,493 - $96,419
    Income Estimation: 
    $92,369 - $122,605
    Income Estimation: 
    $149,493 - $192,976
    Income Estimation: 
    $184,796 - $233,226
    Income Estimation: 
    $77,900 - $95,589
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $101,387 - $124,118
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $119,030 - $151,900
    Income Estimation: 
    $149,493 - $192,976
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Not the job you're looking for? Here are some other GPU Kernel Engineer jobs in the New York, NY area that may be a better fit.

    Software Engineer - GPU Kernel

    Scout AI, New York, NY

    GPU Research Engineer

    Alldus, New York, NY

    AI Assistant is available now!

    Feel free to start your new journey!