The International Conference for High Performance Computing, Networking, Storage, and Analysis

Workshops Archive

Evaluating HPK for Running Cloud-Native Workloads on Slurm Clusters


Workshop: 7th International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC)

Authors: Antony Chazapis and Lefteris Vassilakis (Foundation for Research and Technology - Hellas (FORTH)); Giannis Petsis (Foundation for Research and Technology - Hellas (FORTH); University of Crete, Computer Science Department); Manolis Marazakis (Foundation for Research and Technology - Hellas (FORTH)); and Angelos Bilas (Foundation for Research and Technology - Hellas (FORTH); University of Crete, Computer Science Department)

Abstract: The escalating complexity of applications and services encourages a shift towards higher-level data processing pipelines that integrate both Cloud-native and HPC steps into the same workflow. Cloud providers and HPC centers typically provide both execution platforms on separate resources. In this paper we explore a more practical design that enables running unmodified Cloud-native workloads directly on the main HPC cluster, avoiding resource partitioning and retaining the HPC center's existing job management and accounting policies.


Back to 7th International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC) Archive Listing Back to Full Workshop Archive Listing