The International Conference for High Performance Computing, Networking, Storage, and Analysis
The International Conference for High Performance Computing, Networking, Storage, and Analysis
Workshop: ExaMPI25: Workshop on Extreme Scale MPI
Authors: Shannon Kinkead (Sandia National Laboratories, University of New Mexico); Jackson Wesley (University of New Mexico); Whit Schonbein (Sandia National Laboratories); David DeBonis (Los Alamos National Laboratory (LANL)); Matthew Dosanjh (Sandia National Laboratories); and Amanda Bienz (University of New Mexico)
Abstract: Performant all-to-all collective operations in MPI are critical to fast Fourier transforms, transposition, and machine learning applications. There are many existing implementations for all-to-all exchanges on emerging systems, with the achieved performance dependent on many factors, including message size, process count, architecture, and parallel system partition. This paper presents novel all-to-all algorithms for emerging many-core systems. Further, the paper presents a performance analysis against existing algorithms and system MPI, with novel algorithms achieving up to 3x speedup over system MPI at 32 nodes of state-of-the-art Sapphire Rapids systems.
Back to ExaMPI25: Workshop on Extreme Scale MPI Archive Listing Back to Full Workshop Archive Listing