Demo

Product Manager, LLM Infrastructure

Glean
Palo Alto, CA Full Time
POSTED ON 2/7/2025
AVAILABLE BEFORE 4/6/2025
About Glean

We’re on a mission to make knowledge work faster and more humane. We believe that AI will fundamentally transform how people work. In the future, everyone will work in tandem with expert AI assistants who find knowledge, create and synthesize information, and execute work. These assistants will free people up to focus on the higher-level, creative aspects of their work.

We’re building a system of intelligence for every company in the world. On the surface, you can think of it as Google ChatGPT for the enterprise. Under the hood, our platform is the connective tissue between AI and knowledge. It brings all of a company’s knowledge together, understands it at a deep level, provides industry-leading search relevance over it, and connects it to generative AI agents and applications.

Glean was founded by a seasoned team of former Google search and Facebook engineers who saw a need in the enterprise space for their technical depth and passion for AI. We’re a diverse team of curious and creative people who want to help each other get big things done—so we can help other teams do the same. 

We're backed by some of the Valley's leading venture capitalists—including Sequoia, Kleiner Perkins, Lightspeed, and General Catalyst—and have assembled a world-class team with senior leadership experience at Google, Slack, Facebook, Dropbox, Rubrik, Uber, Intercom, Pinterest, Palantir, and others.
 
Role

As Glean’s PM for LLM Infrastructure, you will evaluate LLM models, define the roadmap for growing Glean’s LLM portfolio, manage relationships with inference and model providers, and determine product strategy for allowing customers to experiment with different LLMs. You will own projections of LLM usage, cost, and capacity planning while driving customer enablement and their upgrade adoption journey for the latest LLMs and LLM-native capabilities.

What you will do and achieve:

  • Spending a lot of time with our customers to deeply understand their knowledge needs
  • Developing key parts of our product roadmap, marrying customers’ needs with our product vision
  • Empowering your team by giving context, setting direction, and building alignment
  • Driving customer-focused decisions, clear prioritization, and efficient execution
  • Coordinating cross-functionally with with leadership, go-to-market teams, and other key stakeholders across the company
  • Building processes that will scale as our team and company go through rapid growth

Who you are:

  • You have 4 years of experience in product management at SaaS companies, primarily serving large enterprises with responsibilities spanning AI/ML Ops and external-facing platform capabilities.
  • Having built or worked with LLMs for at-scale products is a major plus.
  • You have a strong technical background and experience with both UX and API driven products and 3rd party product partnerships.
  • You are an excellent written and verbal communicator.
  • You have a proven track record of taking ownership, taking initiative, and delivering results.
  • You collaborate effectively with cross-functional partners.
  • You have a learning and growth mindset.
  • You are mission-first and understand that your success is measured by your product and team’s success.
  • You are an early adopter in building with or adopting AI for your own product craft and you are excited about helping customers accelerate their own AI adoption journey.

Benefits

  • Competitive compensation
  • Medical, Vision and Dental coverage
  • Flexible work environment and time-off policy
  • 401k
  • Company events
  • A home office improvement stipend when you first join
  • Annual education stipend
  • Wellness stipend
  • Healthy lunches and dinners provided daily

For California based applicants: 

The standard base salary range for this position is $130,000 - $175,000 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. We're committed to an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.

Salary : $130,000 - $175,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Product Manager, LLM Infrastructure?

Sign up to receive alerts about other jobs on the Product Manager, LLM Infrastructure career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$95,865 - $120,012
Income Estimation: 
$123,272 - $153,570
Income Estimation: 
$95,865 - $120,012
Income Estimation: 
$123,272 - $153,570
Income Estimation: 
$147,514 - $184,796
Income Estimation: 
$182,852 - $230,675
Income Estimation: 
$123,272 - $153,570
Income Estimation: 
$150,776 - $185,671
Income Estimation: 
$124,417 - $155,140
Income Estimation: 
$147,514 - $184,796
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Glean

Glean
Hired Organization Address Nashville, TN Full Time
About Glean We’re on a mission to make knowledge work faster and more humane. We believe that AI will fundamentally tran...
Glean
Hired Organization Address Palo Alto, CA Full Time
About Glean We’re on a mission to make knowledge work faster and more humane. We believe that AI will fundamentally tran...
Glean
Hired Organization Address Palo Alto, CA Full Time
About Glean We’re on a mission to make knowledge work faster and more humane. We believe that AI will fundamentally tran...
Glean
Hired Organization Address Philadelphia, PA Full Time
SPECIAL NOTE ABOUT THIS OPPORTUNITY: Candidates are required to reside in the North East Region About Glean We’re on a m...

Not the job you're looking for? Here are some other Product Manager, LLM Infrastructure jobs in the Palo Alto, CA area that may be a better fit.

Product Manager - AI Infrastructure

Cisco Systems, Inc., San Jose, CA

AI Assistant is available now!

Feel free to start your new journey!