Technical Product Manager, Large Language Model Platforms - CTO Office

Bloomberg's CTO Office is the future-looking technical and product arm of Bloomberg L.P. We envision, design, and prototype the next generation infrastructure, hardware, and applications for the Bloomberg Terminal. Our projects include machine learning-powered products, cloud computing infrastructure and strategy, open source stewardship, natural language processing, and more. We are passionate about what we do.

What's In It For You

Bloomberg is looking for a Technical Product Manager to shape and execute the vision, and roadmap for the next-generation Bloomberg Generative AI platform. As a Technical Product Manager, you will have ownership over a suite of infrastructure, grow our Generative AI services, expand our user base, and build out new features and capabilities to fulfill our mission. You'll be making decisions on how to streamline onboarding, improve our hardware & model performance, and architect robust, resilient and efficient LLM serving infrastructure. You will interact very closely with internal stakeholders from product and engineering. This is a high-leverage role in a very cross-functional environment, so you'll need to be comfortable wearing many hats and balancing technical expertise with business acumen. You will work in a group of other highly motivated product managers that work on a range of adjacent projects in AI.
We'll trust you to

• Develop a long-term vision and roadmap that incorporates the latest advances from academia and industry for Bloomberg's next-generation large language model infrastructure.
• Plan and execute the management of compute, cloud and services to provide large language model infrastructure that is robust, resilient and forward looking.
  
• Translate product roadmap features and requirements into well-crafted, testable user stories and acceptance test criteria, set priorities and define the scope whilst effectively managing resources.
  
• Interact with end users and a diverse group of partners to understand their workflows and technical requirements and their needs for large language model serving and training.
  
• Work closely with stakeholders across the company to develop an understanding of capabilities, constraints and opportunities, anticipate scale challenges, map business requirements to technical vision, and increase service capabilities to better support internal and external partners.
  
• Work in an Agile environment and continuously review business needs, refine priorities, outline milestones and deliverables, and identify opportunities and risks.
• Do the right thing; be part of a Product team and CTO organization that optimizes for the long term

You'll need to have:

• 5 years of experience with technical product management or technical leadership
• A product-driven focus, with product management, organizational, and communication skills to effectively coordinate and work with Engineers, other Product Managers, and Senior Management
• 5 years of experience with Distributed Systems, Kubernetes, knowledge in cloud computing platforms, or experience with public cloud providers such as AWS, Google Cloud Platform, or Azure
• A passion for providing reliable, scalable, and easy-to-use infrastructure
• A strong technical or Engineering background, broad technical technical fluency
• A track record of shaping business strategy and roadmaps for technical products
• Advanced degree (Masters or Ph.D) or equivalent experience in a computing discipline with a specialization in deep learning or ML systems

We'd love to see:

• Breadth of knowledge or familiarity in MLOps platforms & Machine Learning toolkits
• Applied experience optimizing HPC workloads for AI & ML
• Experience with capacity planning, resource management, accounting in multi-tenant environments, and hardware vendor management
• Open source involvement or community presence
• A good understanding of financial markets, instruments and products
• Exposure to Bloomberg Terminal and/or enterprise data products

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.