HPC-AI Solution Architect

HPC/AI Architect (Federal)

Job Summary:

The HPC/AI Architect will be responsible for architecting, designing, and optimizing high-performance computing (HPC) and artificial intelligence (AI) infrastructure, ensuring the systems meet the requirements for scalability, efficiency, and performance. The role demands a blend of expertise in HPC, AI, and system architecture, along with the ability to manage projects from conception through implementation. This role will also involve proactive engagement with stakeholders and staying at the forefront of technological advancements.

Recruiting for this role ends on May 31, 2025

Key Responsibilities:

• System Architecture and Design: Develop and refine the architecture for HPC and AI systems. This includes defining system requirements, designing computational workflows, and selecting appropriate hardware and software configurations. Assist teams with the implementation, tuning, and optimization of Generative AI models tailored for federal government applications.
• Performance Optimization: Analyze and optimize system performance, ensuring the efficient execution of AI models and HPC applications. Implement techniques for parallel processing, distributed computing, and resource management. Manage and optimize GPU enabled computing fabric.
• Integration and Optimization: Develop, debug, and maintain software tools, libraries, and frameworks that support HPC and AI workloads. Work closely with vendor hardware and software providers to ensure AI models are properly optimized for maximum performance and scalability.
• NVidia Tools and Frameworks: Utilize NVidia's suite of tools and frameworks, such as CUDA, DNN, and TensorRT, to optimize AI and HPC workloads on NVidia GPUs.
• HPC Systems Support: Implement and manage HPC and AI systems on-premise, and in COLO facilities ensuring seamless integration with existing IT infrastructure. This includes the installation, configuration, and maintenance of the HPC infrastructure.
• Collaboration and Teamwork: Work with cross-functional teams, including alliance partners, data scientists, researchers, and software developers to solve complex AI related challenges. Provide training and mentorship to junior engineers and team members, fostering a culture of continuous learning and innovation within the team.
• Learning and Development: Stay updated with the latest advancements in HPC and AI technologies. Conduct research to explore new methodologies and integrate them into existing systems as requested.
• Technical Support and Troubleshooting: Provide support for resolving complex technical issues related to HPC and AI infrastructure. Perform root cause analysis and implement solutions to prevent recurrence.
• Documentation and Reporting: Create comprehensive documentation for system designs, performance metrics, and project status. Prepare detailed technical reports and presentations for stakeholders.
• Security and Compliance - Ensure that all HPC, AI systems, and software tools and frameworks comply with federal security and regulatory requirements. Work with Deloitte Federal BISO to implement controls to protect sensitive data and intellectual property relative to NIST guidelines.

Required Skills and Qualifications:

• 7 years professional experience designing and managing HPC and AI architectures with a proven track record of successful project implementations.
• 3 years of experience in the design, support, and management of Kubernetes
• Linux: In-depth experience of at least one Linux distribution including configuration of kernels, bootloaders, networking, and CLI.
• 3 years working with Machine Learning Frameworks: Deep understanding of TensorFlow, PyTorch, and/or other AI/ML frameworks.
• 1 year of NVIDIA Expertise: Extensive experience with NVIDIA's AI tools and frameworks such as CUDA, NeMo, and Triton
• Bachelors Degree in Computer Science, Artificial Intelligence, Engineering, or a closely related field
• Limited immigration sponsorship may be available
• Ability to travel 0-10%, on average, based on the work you do and the clients and industries/sectors you serve

Preferred Qualifications:

• Master's or Ph.D. in Computer Science, Artificial Intelligence, Engineering, or a closely related field
• Programming Languages: Proficiency in Python, C , Java, and scripting languages commonly used in HPC/AI environments. Proven python coding experience with expertise in at least one additional scripting or programming language. Python package management and dependency debugging skills a plus
• AI Development Support: Proven ability to troubleshoot distributed AI model training frameworks like TensorFlow, Pytorch, Horovod, Ray, DeepSpeed, and others. Experience supporting Large Language models a plus.
• 1 year Project Management: Experience managing large-scale projects, including timeline development, resource allocation, and risk management.
• Parallel and Distributed Computing: Expertise in parallel programming models (MPI, OpenMP), distributed computing, and cloud based HPC solutions.
• System Performance: Strong knowledge of performance profiling, benchmarking, and optimization techniques.
• Data Management: Understanding of data storage solutions, file systems, and data transfer protocols.
• Communication Skills: Excellent verbal and written communication skills for effective collaboration and reporting.
• Analytical Skills: Strong analytical skills for data-driven decision making and ability to solve complex problems and develop innovative solutions.
• May require a security clearance
• Helpful to have knowledge of the Federal government.
• Industry Experience: Background in supporting HPC/AI in the Federal Government or Defense
• Industry sector a plus.

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $107,000 to $198,000.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html

EA_ExpHire

#LI-LH1