Workshop: 3rd International Workshop on HPC Testing and Evaluation of Systems, Tools, and Software (HPCTESTS 2025)
Authors: Nick Hagerty and Dan Dietz (Oak Ridge National Laboratory (ORNL))
Abstract: In 2005, the U.S. Department of Energy created the Oak Ridge Leadership Computing Facility (OLCF) to deploy one-of-a-kind leadership computing resources for researchers across academia, industry, and government. These supercomputers are among the largest in the world and often diverge from conventional architectures, demanding flexible and thorough testing to ensure their functionality and performance. To support this testing, OLCF developed the OLCF Test Harness (OTH). The OTH has adapted through more than 20 years of novel architectures. Unique challenges with each system provide opportunities for continuously improving the OTH. The OTH recently released version 3.0, which implements support for logging test data to InfluxDB, and version 3.1, which extends support further. Among three well-known testing frameworks surveyed, only one documents features that could be leveraged for database logging. In this work, we describe the OTH and the database support within, and discuss the challenges, successes, and goals for the OTH.
Back to 3rd International Workshop on HPC Testing and Evaluation of Systems, Tools, and Software (HPCTESTS 2025) Archive Listing Back to Full Workshop Archive Listing