SC24 BoF: Global Data Streaming Community Building: Lessons Learned and Potential Tools

Exciting news for those interested in data streaming! The SC24 BoF event titled “Building a Global Data Streaming Community” explored lessons learned, potential tools, challenges, and opportunities in European and US ecosystems. While data streaming is not as commonly used in High-Performance Computing (HPC), it holds significant potential for critical applications with substantial societal and scientific impact.

This engaging session discussed use cases like Destination Earth, the Large Hadron Collider, the Square Kilometre Array, Exa-AToW, and Earth systems digital twins by NASA. These initiatives heavily rely on HPC infrastructures and are exploring how to effectively stream measurement/sensor or simulation data to support their objectives.

Key leaders at this event included Sai Narasimhamurthy from ETP4HPC and ParTec AG, Mike Little from NASA, Thomas Geenen from ECMWF, and several other notable experts. By sharing insights, exploring lessons learned, and fostering integration with existing HPC systems, the aim is to establish a global HPC Data Streaming Community.

This forward-looking workshop took place in Atlanta, GA, USA, offering a valuable opportunity to delve deeper into this exciting field. Don’t miss out on future events, as they promise to deliver cutting-edge insights and explore the potential of data streaming in large data systems.