What are the responsibilities and job description for the Systems/GPU Programmer position at Vast.ai?
About Us
At Vast.ai, we value creativity, energy, drive and teamwork. We are looking for talented people who share these values to join as we grow our team. Our vision is to widely distribute AI computing to reshape our future for the good of humanity. Come join us.
Vast.ai is a market based cloud computing platform focused on reducing the cost and friction of compute-intensive workloads, enabling anyone to easily leverage large-scale GPU liquidity. Our GPU marketplace powers AI projects and businesses all over the world.
If witnessing the birth of AGI excites you, we can’t wait to hear from you!
NOTE: Currently hiring for on-site work at either our San Francisco or Westwood, Los Angeles office.
About the Role
As a systems/GPU programmer you will play a crucial role in developing new matrix multiplication kernels and algorithms that can improve inference for AI models. You will help develop new high performance tensor libraries and auto optimization tools. Working closely with the technical CEO and founder, you will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems. Your ability to research and stay on top of cutting edge papers will be vital in staying up-to-date with the latest advancements in AI model inference and GPU programming techniques.
Example Projects
- Implement new high performance sparse matrix multiplication kernels
- Create highly parallel GPU code graph translation and optimization systems
- Develop or extend parallel generic GPU libraries for approximate sorting, k-max, hash tables, etc
- Help design and deploy new market based resource management systems for our host daemon
- Quickly investigate and summarize options for new system architectures
You Are
- Deeply comfortable in C , template meta-programming, CUDA, GPGPU, Linux
- Capable and willing to quickly investigate and learn new frameworks and tools
- A fan of occasional remote pair programming
- Passionate about pushing the envelope in neural network performance and tooling
- Excited about the potential of AI
Annual Salary Range
$160,000 - $320,000 equity benefits
Vast.ai is hiring across all experience levels with compensation commensurate with background and experience.
Benefits
- Health, dental, vision and life insurance coverage
- Matching 401K
- Ambitious, fast-paced startup environment
- Generous equity