The International Conference for High Performance Computing, Networking, Storage, and Analysis
The International Conference for High Performance Computing, Networking, Storage, and Analysis
Authors: Megan Larko (Translucent/Penguin Solutions, OpenSFS Org), Frank Baetke (European Open File System Association(EOFS)), Peter Jones (Whamcloud, DDN), Andreas Dilger (Whamcloud, inc.; DDN)
Abstract: Lustre is the leading open-source and open-development file system for HPC. Eight of the top 10 and 64% of the top 100 systems on the most recent Top500 list use Lustre. It is a community-developed technology with contributors from around the world. Lustre supports many HPC infrastructures such as research, finance, energy, and manufacturing. Lustre clients are available for instruction set architectures such as x86, POWER, and ARM.
At this BoF, Lustre users, developers, administrators, and solution providers will gather to ask questions and discuss recent Lustre developments and challenges, including the role of Lustre in AI and its use in cloud environments. People new to Lustre will get a feel for the power of this HPC shared file system.
Long Description: Lustre is the leading open-source and open-development file system for HPC. Approximately two thirds of the top 100 supercomputers use Lustre file systems. Six of the IO500 top 10 use a version of Lustre to achieve superior performance results. Forty-seven percent of the IO500 List use Lustre.[1] Lustre is a community-developed file system with contributors from around the world. Lustre supports many HPC infrastructures beyond its traditional stronghold of scientific research including financial services, energy, manufacturing, life sciences and animation and Lustre clients are available for ISAs such as x86, POWER, and Arm. Major cloud vendors AWS, GCP, OCI and Azure all have Lustre offerings.
Lustre is suitable for a wide variety of workloads. It is capable of handling both small and large IO segments and files. Lustre has a successful and rich history of high performance and reliability which continues to evolve and improve. It has an attainable starting point and offers a cost-effective option for scalable, high-performance HPC storage on a multitude of system designs, network topologies. It continues to be one of the most widely adopted technologies in HPC around the world.
At this BOF, Lustre developers, administrators, and solution providers will gather to discuss recent developments, such as the upcoming Lustre 2.17 release, continuing Long Term Support (LTS) for Lustre 2.15, and new challenges and corresponding opportunities.[2] There will be some discussions of best practices, optimizing file system access, metrics, file system enhancements and other Lustre-related items.
The community is vital to the technology that continues to drive Lustre forward. As Lustre has evolved into a true open-source and open-development model, the end users, developers, and solution providers have come together through the worldwide OpenSFS and EOFS communities. The Lustre Users Group (LUG) and International Supercomputing (ISC) conferences facilitate the sharing of ideas and foster the community involving Lustre. This community development model has resulted in significant new features, improved stability and broader adoption.
The 2025 Lustre BOF will focus on feature developments, such as the Erasure Coding and Hybrid IO. A highlight is a panel discussion from key developers, site administrators, and vendors providing the audience a chance to ask questions. Across all key-application segments, Lustre is at the heart of many HPC infrastructures and must continue to evolve in order to support emerging use cases including the scalability challenges associated with exascale systems.
The Lustre BOF has been held at previous SC events and has been well attended and enthusiastically received. SC presents an opportunity for the worldwide Lustre community to meet and discuss how to make Lustre more successful. SuperComputing Lustre BoF continues to attract many attendees.
The targeted audience includes all who are involved with Lustre deployments such as administrators, system architects, developers, solution providers and end users. It includes all who have been contributing or reviewing new features or providing additional tools for management and control.
[1] https://io500.org/
[2] https://www.lustre.org/wp-content/uploads/Community-Release-Roadmap-v41.jpg
Website: http://www.lustre.org