Demo

Head of Infrastructure

795b0fc78924510bbd095de6fe06799b
New York, NY Full Time
POSTED ON 3/19/2025
AVAILABLE BEFORE 4/17/2025

About FluidStack

Over the last several years, AI has transformed from a niche technology to one that is surpassing human-level performance on a diverse range of tasks. As a consequence, the amount of compute used for training and inference has grown 5x year-on-year. Plans are being made for training runs that cost upwards of one billion USD and companies are planning to spend hundreds of billions on AI infrastructure in the coming few years.

FluidStack is accelerating this trend, building and operating GPU supercomputers for top AI labs, governments, and enterprises. Our customers include Mistral, Poolside, Black Forest Labs, Meta, and more.

Our team is lean, highly motivated, and focused on providing the world's best supercomputing experience. We put our customers first in everything we do, and we hold ourselves and each other to insanely high standards. We expect you to care deeply about the work you do, the products you build, and the experience our customers have in every interaction with us.

About the Role

FluidStack is hiring a Head of Infrastructure to lead deployments of 10,000 GPU supercomputers globally. Reporting directly to the co-founder / president, you will lead our engagements with OEMs, data centers, ISPs, and all relevant infrastructure partners. You will own sourcing, procurement, and be responsible for the timely deployment of some of the largest GPU supercomputers in the world.

You will be in charge of building a world-class deployment team to deliver multi-thousand GPU clusters in a matter of days. This is a unique opportunity to build the infrastructure function from the ground up in an extremely fast-paced environment, as well as a chance to shape the future of AI.

You are expected to have exceptional technical and interpersonal communication skills. You should be able to concisely and accurately share knowledge, in both written and verbal form, with teammates, customers, and suppliers.

Focus

  • You are responsible for the entire supply chain, from the original sourcing of each individual component up to the handover of the burned-in cluster to our customer.
  • You own relationships with OEMs, with the responsibility of continuously improving delivery timelines and costs across the entire supply chain.
  • You will design and build AI clusters, combining your deep knowledge in the area with high-level customer requirements and our past deployment learnings.
  • You are responsible for sourcing additional data center capacity to support our rapidly scaling supercomputer business.
  • You will hire and manage a small but effective "swat team" of deployment engineers, responsible for the world's fastest setup, burn-in, and delivery of reliable GPU clusters.
  • You will partner with engineering, sales, finance, and legal to always have infrastructure ready one step ahead of our customer needs.
  • You will be required to travel significantly, be it to conferences / trade shows, data centers, customer sites, OEM factories, etc.

About You

An ideal candidate meets at least the following requirements :

  • 3 years of related experience deploying GPU clusters; 5 years deploying infrastructure at global scale.
  • On-site experience physically setting up hardware in data centers.
  • Strong relationships with, and history of procuring from, compute and storage OEMs, data centers, ISPs, and others.
  • Experience with InfiniBand or RoCE networking deployments.
  • An understanding of the software that runs on these clusters : Kubernetes / SLURM, PyTorch / Jax, etc.
  • Extreme attention to detail and ability to prioritize and deliver in a fast-paced environment.
  • Highly proactive with an extreme sense of urgency and ownership.
  • Strong engineering background, preferably in Computer Engineering, Electrical Engineering, Computer Science, Software Engineering, Math, Operations Research, Logistics, or similar fields.
  • Exceptional candidates have one or more of the following experiences :

  • You have designed, built, and operated a 4000 GPU cluster.
  • You have build tooling to manage bare metal hardware via MaaS, Netbox, or similar tooling.
  • You have deployed and managed petabyte scale all-flash storage systems, including DDN, VAST, and / or Weka; or Ceph, LUSTRE, or similar open source tools.
  • Benefits

  • Competitive total compensation package (salary equity).
  • Retirement or pension plan, in line with local norms.
  • Health, dental, and vision insurance.
  • Generous PTO policy, in line with local norms.
  • All-paid business travel to hardware and data center shows around the world.
  • If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Head of Infrastructure?

    Sign up to receive alerts about other jobs on the Head of Infrastructure career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $199,907 - $266,531
    Income Estimation: 
    $228,175 - $287,213
    Income Estimation: 
    $225,749 - $313,190
    Income Estimation: 
    $219,220 - $297,182
    Income Estimation: 
    $195,700 - $270,403
    Income Estimation: 
    $76,575 - $97,677
    Income Estimation: 
    $96,881 - $126,079
    Income Estimation: 
    $144,983 - $187,977
    Income Estimation: 
    $85,996 - $102,718
    Income Estimation: 
    $111,859 - $131,446
    Income Estimation: 
    $110,457 - $133,106
    Income Estimation: 
    $105,809 - $128,724
    Income Estimation: 
    $122,763 - $145,698
    Income Estimation: 
    $105,809 - $128,724
    Income Estimation: 
    $136,611 - $163,397
    Income Estimation: 
    $135,163 - $163,519
    Income Estimation: 
    $131,953 - $159,624
    Income Estimation: 
    $150,859 - $181,127
    Income Estimation: 
    $96,881 - $126,079
    Income Estimation: 
    $121,901 - $159,768
    Income Estimation: 
    $144,983 - $187,977
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Not the job you're looking for? Here are some other Head of Infrastructure jobs in the New York, NY area that may be a better fit.

    Head of Infrastructure Services

    Private Client Select, New York, NY

    VP, Head of Infrastructure and Engineering

    J.S. Held LLC, New York, NY

    AI Assistant is available now!

    Feel free to start your new journey!