Workshops Archive

Invited Talk: State-of-the-Art Communication Software for Supercomputers and Its Applications

Workshop: 14th International Workshop on Runtime and Operating Systems for Supercomputers (ROSS 2025)

Authors: Jeff Hammond (NVIDIA)

Abstract: This talk will focus on high-performance communication software for GPU supercomputers. It will explain NCCL and NVSHMEM, including their historical context from MPI and SHMEM. The functionality and performance will be demonstrated through an example from linear algebra. Real world results from both scientific and commercial AI use cases will be described.

Back to 14th International Workshop on Runtime and Operating Systems for Supercomputers (ROSS 2025) Archive Listing Back to Full Workshop Archive Listing