Demo

Senior Software Architect - Deep Learning and HPC Communications

Karkidi
Santa Clara, CA Full Time
POSTED ON 4/18/2025
AVAILABLE BEFORE 5/5/2025

We are the GPU Communications Libraries and Networking team at NVIDIA. We build communication libraries like NCCL, NVSHMEM, and UCX that are crucial for scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.

DL and HPC applications have huge compute demands and already run at scales of up to tens of thousands of GPUs. GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision?

What you will be doing :

  • Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.
  • Design and implement new communication technologies to accelerate AI and HPC workloads.
  • Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects.
  • Build proofs-of-concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
  • Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs).

What we need to see :

  • M.S. / Ph.D. degree in CS / CE or equivalent experience.
  • 5 years of relevant experience.
  • Excellent C / C programming and debugging skills.
  • Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
  • Deep understanding of operating systems, computer and system architecture.
  • Solid fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
  • Strong experience with Linux.
  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.
  • Ways to stand out from the crowd :

  • Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc.
  • Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications.
  • Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment.
  • The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

    You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

    NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

    J-18808-Ljbffr

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Senior Software Architect - Deep Learning and HPC Communications?

    Sign up to receive alerts about other jobs on the Senior Software Architect - Deep Learning and HPC Communications career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $117,871 - $153,580
    Income Estimation: 
    $131,745 - $167,716
    Income Estimation: 
    $144,503 - $184,592
    Income Estimation: 
    $102,541 - $137,871
    Income Estimation: 
    $153,752 - $200,235
    Income Estimation: 
    $73,800 - $91,103
    Income Estimation: 
    $89,966 - $112,616
    Income Estimation: 
    $95,407 - $122,738
    Income Estimation: 
    $103,114 - $138,258
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $89,966 - $112,616
    Income Estimation: 
    $118,163 - $145,996
    Income Estimation: 
    $120,777 - $151,022
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $118,163 - $145,996
    Income Estimation: 
    $145,845 - $177,256
    Income Estimation: 
    $147,836 - $182,130
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $145,845 - $177,256
    Income Estimation: 
    $172,688 - $210,712
    Income Estimation: 
    $170,589 - $211,671
    Income Estimation: 
    $178,619 - $225,190
    Income Estimation: 
    $86,891 - $130,303
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Karkidi

    Karkidi
    Hired Organization Address Boston, MA Full Time
    Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capt...
    Karkidi
    Hired Organization Address San Jose, CA Full Time
    The opportunity : From the moment you wake up in the morning until you go to bed at night consider the media you consume...
    Karkidi
    Hired Organization Address San Francisco, CA Full Time
    What you’ll be doing : From a research perspective, exploring, prototyping, validating, and iterating new algorithms. On...
    Karkidi
    Hired Organization Address San Jose, CA Full Time
    About TredenceTredence is a global analytics services and solutions company. We are one of the fastest growing private c...

    Not the job you're looking for? Here are some other Senior Software Architect - Deep Learning and HPC Communications jobs in the Santa Clara, CA area that may be a better fit.

    AI Assistant is available now!

    Feel free to start your new journey!