What are the responsibilities and job description for the GPU Kernel Engineer position at MakoAvance Consulting?
Company Brief :
We are a venture-backed tech startup building software infrastructure for high performance AI inference and training on any hardware. There are three core components :
1. Our Compiler automatically selects, tunes, and generates GPU kernels for any hardware platform
2. Our Runtime serves compiled models at high performance
3. Our Platform enables users to easily deploy and manage deployments across any cloud (you’ll be working on this!)
Job Description / Key Responsibilities :
- Explore and analyze performance bottlenecks in ML training and inference.
- Develop and optimize high-performance computing kernels in Triton, CUDA, and / or ROCm.
- Implement programming solutions in C / C and Python.
- Deep dive into GPU performance optimizations to maximize efficiency and speed.
- Collaborate with the team to extend and improve existing machine learning compilers or frameworks such as MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT. (This is optional but beneficial)
Qualifications
Bonus