The International Conference for High Performance Computing, Networking, Storage, and Analysis

Workshops Archive

Invited Talk: Alternative Parallel Programming Models: Past, Present, and Is There a Future?


Workshop: The 8th Annual Parallel Applications Workshop: Alternatives To MPI+X (PAW-ATM 2025)

Authors: Laxmikant (Sanjay) Kale (University of Illinois Urbana-Champaign)

Abstract: In this talk, I will describe my perspective as a researcher for 40 years on the topic of parallel programming models. Given the time constraints, I will only present a small sample of programming models including my group's, and focus on broader themes. Before MPI, there were parallel logic and functional languages, and then precursors to MPI like nxlib. These and the process of development of the MPI standard and its consequence will be discussed. Among the many alternative models that were developed, some were meant as competitors, some raised level of abstraction, or supported specialization. We will review a few models that survive today, including Charm++, Chapel, HPX and a few more. We will examine what the future programming model landscape may look like and what issues will shape them, including but not focusing solely on the needs of machine learning, data analytics or accelerators.


Back to The 8th Annual Parallel Applications Workshop: Alternatives To MPI+X (PAW-ATM 2025) Archive Listing Back to Full Workshop Archive Listing