The International Conference for High Performance Computing, Networking, Storage, and Analysis

Workshops Archive

Streaming X-ray Detector Data to Remote Facilities Using EJFAT


Workshop: XLOOP 2025: The 7th Annual Workshop on Extreme-Scale Experiment-in-the-Loop Computing

Authors: Sinisa Veseli, John Hammonds, Steven Henke, Madeline Miller, and Hannah Parraga (Argonne National Laboratory (ANL)); Ilya Baldin (Thomas Jefferson National Accelerator Facility); Derek Howard and Yatish Kumar (Energy Sciences Network (ESnet)); and Nicholas Schwarz (Argonne National Laboratory (ANL))

Abstract: Propelled by the increasing need for the near real-time feedback for user experiments on its X-ray beamlines, the Advanced Photon Source continues to investigate the use of streaming workflows, with several of those being successfully deployed on its local computing infrastructure. With ever-growing data volumes and compute resource needs, the ability to analyze beamline data at remote facilities is becoming more and more important.

In this paper we investigate the possibility of using ESnet JLab FPGA Accelerated Transport (EJFAT) project infrastructure to bring X-ray detector data directly from the instrument into an analysis application running at a remote high performance computing center. To that end, we describe successful integration of PvaPy, a Python API for the EPICS PV Access protocol, with the EJFAT software library. We also discuss potential use cases, as well as illustrate system performance in terms of maximum achievable frame and data rates in a test environment.


Back to XLOOP 2025: The 7th Annual Workshop on Extreme-Scale Experiment-in-the-Loop Computing Archive Listing Back to Full Workshop Archive Listing