Demo

AI Infrastructure Engineer

Fireworks AI
Redwood, CA Full Time
POSTED ON 2/28/2025
AVAILABLE BEFORE 5/25/2025

Job Duties :

Design core, backend software components. Interface with other teams to incorporate their innovations and vice versa. Conduct design and code reviews. Analyze and improve efficiency, scalability, and stability of various system resources. Design and implement the hardware and software infrastructure required for AI projects. Procure, configure, and manage servers, GPUs, TPUs, and other hardware resources. Set up cloud-based environments (e.g., AWS, Azure, GCP) for AI workloads. Deploy and manage distributed computing clusters (e.g., Kubernetes) for AI model training and inference. Optimize cluster performance and resource allocation for AI workloads. Monitor cluster health and troubleshoot issues as they arise. Architect and maintain data storage solutions (e.g., data lakes, databases) for AI datasets. Ensure data security, access controls, and data versioning. Implement data pipelines for efficient data ingestion and preprocessing. Develop and maintain automation scripts and tools for infrastructure provisioning and scaling. Implement continuous integration and continuous deployment (CI / CD) pipelines for AI models. Orchestrate workflows for training, evaluation, and deployment of AI models. Optimize infrastructure to handle large-scale AI workloads efficiently. Monitor and analyze system performance, making adjustments as needed. Implement load balancing and scaling strategies to meet demand. Implement security best practices to protect AI infrastructure and data. Stay up-to-date with security vulnerabilities and apply patches and updates. Ensure compliance with relevant data privacy and regulatory requirements. Collaborate with data scientists and AI engineers to understand their infrastructure needs. Provide technical support and troubleshooting assistance for AI infrastructure issues. Train and educate team members on best practices for using AI infrastructure.

Minimum Education & Experience Required :

Must have Bachelor's degree or the equivalent in Computer Science, Computer Engineering or a related field, plus three (3) years of experience with ML infrastructure (PyTorch, Vertex AI, and Sagemaker) or related experience.

Minimum Skills Required :

Must have experience with : Experience with one or more search engine, recommendations, natural language processing, personalization, or similar applied ML domain. Experience with building, scaling, and optimizing distributed enterprise-grade Machine Learning systems. Experience with architectural patterns of large-scale software applications. Experience with publishing papers in machine learning and / or computer vision conferences and journals. Experience with large-scale machine learning techniques like semi-supervised learning, weakly-supervised learning, and online adaptation of ML models. Experience with publishing machine learning domains such as computer vision and natural language processing.

How to Apply :

Submit resume and apply online at and search for job by title.

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Infrastructure Engineer?

Sign up to receive alerts about other jobs on the AI Infrastructure Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$85,996 - $102,718
Income Estimation: 
$111,859 - $131,446
Income Estimation: 
$110,457 - $133,106
Income Estimation: 
$105,809 - $128,724
Income Estimation: 
$122,763 - $145,698
Income Estimation: 
$178,619 - $225,190
Income Estimation: 
$132,903 - $169,021
Income Estimation: 
$144,671 - $184,917
Income Estimation: 
$136,361 - $179,761
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$103,114 - $138,258
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$145,845 - $177,256
Income Estimation: 
$147,836 - $182,130
Income Estimation: 
$154,597 - $194,610
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$81,253 - $112,554
Income Estimation: 
$89,966 - $112,616
Income Estimation: 
$95,407 - $122,738
Income Estimation: 
$103,114 - $138,258
Income Estimation: 
$86,891 - $130,303
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Fireworks AI

Fireworks AI
Hired Organization Address Redwood, CA Full Time
About Us : Here at Fireworks, we’re building the future of generative AI infrastructure. Fireworks offers the generative...
Fireworks AI
Hired Organization Address Redwood, CA Full Time
Here at Fireworks, we’re building the future of generative AI infrastructure. Fireworks offers the generative AI platfor...
Fireworks AI
Hired Organization Address Redwood, CA Full Time
At Fireworks, we are pioneering the future of generative AI infrastructure. Our platform offers the highest-quality AI m...

Not the job you're looking for? Here are some other AI Infrastructure Engineer jobs in the Redwood, CA area that may be a better fit.

ML Infrastructure Engineer, AI Research Team

Gatik AI, Mountain View, CA

AI Assistant is available now!

Feel free to start your new journey!