What are the responsibilities and job description for the GPU Kernel Engineer position at Mako?
### Summary
Our R&D team is focused on creating the most efficient engine for deploying generative AI models, with efforts ranging from precise GPU kernel tuning to comprehensive system optimizations.
We're looking for an expert level engineer with a strong background in either CUDA, ROCm, or Triton kernel optimization. Your role will involve leading substantial improvements in GPU performance and playing a key role in pioneering AI and machine learning initiatives.
### About Mako
Mako is a venture-backed tech startup building software infrastructure for high performance AI inference and training on any hardware. There are three core components:
1. Mako Compiler automatically selects, tunes, and generates GPU kernels for any hardware platform
2. Mako Runtime serves compiled models at high performance
3. Mako Platform enables users to easily deploy and manage deployments across any cloud (you’ll be working on this!)
### Responsibilities
- Explore and analyze performance bottlenecks in ML training and inference.
- Develop and optimize high-performance computing kernels in Triton, CUDA, and/or ROCm.
- Implement programming solutions in C/C and Python.
- Deep dive into GPU performance optimizations to maximize efficiency and speed.
- Collaborate with the team to extend and improve existing machine learning compilers or frameworks such as MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT. (This is optional but beneficial)
### Qualifications
- Bachelor's, Master’s or PhD’s degree in Computer Science, Electrical Engineering, or a related field.
- Strong programming skills in C/C and Python.
- Deep understanding and experience in GPU performance optimizations.
- Proven experience with kernel optimizations on CUDA, ROCm, or otheraccelerators.
- General experience with the training and deployment of ML models
- Experience with distributed systems development or distributed ML workloads
### Bonus Points
- Experience with innovative OSS projects like FlashAttention, mlc-llm, vllm.
- Experience with machine learning compilers or frameworks such as TVM, MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT.
### Our Benefits
- Competitive salary package
- Performance-based bonuses and incentives
- Comprehensive health insurance coverage for you and your family
- Flexible working hours and remote work options
- Professional development opportunities, including training programs and conferences
- Generous vacation and paid time off policy
- Company-sponsored social activities and team-building events
- Modern and comfortable work environment with state-of-the-art equipment and facilities
### To Apply
[**Fill out this form](https://jobs.mako-dev.com/15a546aebc368051ab46e9a19bcf3946) or:**
- Send an email to [jobs@mako-dev.com](mailto:jobs@mako-dev.com) with subject line: “**Senior Full-Stack Software Engineer”**
- Attach your resume as a PDF file
- Include in the body of the email any additional information we should be aware of, such as a GitHub account or blog posts you’ve authored.