What are the responsibilities and job description for the Benchmarking and Performance Specialist position at Positron AI?
About Positron AI
Positron delivers vendor freedom and faster inference for both enterprises and research teams, by allowing them to use hardware and software explicitly designed from the ground up for generative and large language models (LLMs).
Through lower power usage and drastically lower total cost of ownership (TCO), Positron enables you to run popular open source LLMs to serve multiple users at high token rates and long context lengths. Positron is also designing its own ASIC to expand from inference and fine tuning to also support training and other parallel compute workloads.
About the role
- You'll be joining our data center team, profiling performance on various open source models across hardware and software builds
What you'll do
Qualifications