Data Streaming using HDF5 and HSDS

18 Nov 2025, 14:45
30m
Presentation Visualization and Digital Twin Tuesday Afternoon

Speaker

John Readey (The HDF Group)

Description

HDF5 is an excellent storage system for collecting large amounts of scientific data but using it to collect real-time data from multiple sensors can be a challenge since the HDF5 library doesn't support multi-process writers. HSDS (HDF5 Scalable Data Service) enables the HDF5 data model to be accessed over the network using REST-based HTTP requests and enables simultaneous connections from any number of clients.

In this session, I'll demonstrate how HSDS can be used to collect data from multiple sensor streams and display real-time data in a web application.

Primary author

John Readey (The HDF Group)

Presentation materials