What are the responsibilities and job description for the Project Manager, Hardware & Business Operations position at Together AI?
Project Manager, Hardware & Business Operations
Location :
San Francisco, CA (Hybrid)
Role : As the first Project Manager for hardware at a pioneering AI infrastructure company, you will be at the core of optimizing and scaling our decentralized GPU resources. Your role is crucial in ensuring that the backbone of our AI models-thousands of GPUs distributed across multiple data centers-operates efficiently and reliably, enabling cutting-edge AI advancements that democratize access to AI technology globally. You'll have the opportunity to shape the future of AI infrastructure, working alongside top engineers and innovators to power the next generation of AI-driven solutions.
Responsibilities :
- Monitor and manage GPU hardware inventory across multiple decentralized data centers; track the lifecycle of GPUs, including acquisition, deployment, usage, maintenance, and decommissioning
- Develop and maintain a system to log and track all GPU outages or malfunctions, including the root cause analysis, downtime duration, and replacement cycles; generate reports on utilization, availability, and performance trends, and recommend improvements
- Continuously seek opportunities to improve GPU tracking processes and systems, including the implementation of automation and data analytics dashboards
- Work with engineering, customer success, and operations to resolve outages, documenting resolutions and lessons learned for continuous improvement
- Develop and maintain strong relationships with GPU suppliers to ensure favorable terms and timely deliveries
- Prepare clear billing summaries, breaking down costs to justify charges based on usage, and serve as the primary contact for billing inquiries from customers
Requirements
Nice to Have :
About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is : $111,000 - $165,000 equity benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our Privacy Policy at https : / / www.together.ai / privacy
Salary : $111,000 - $165,000