Adding Streaming Capabilities to HDF5

Many applications involved in real-time data collection need to monitor their data while it is being collected- This need occurs in a large and growing number of applications that use common scientific hierarchical data formats for data management, such as aircraft flight testing, autonomous vehicles, particle accelerators, and many more- There are two shortcomings to these formats that make it difficult to use during data acquisition, and this can force applications into expensive and awkward alternate solutions: (1) the ability to write data at very high speeds and at the same time to read back that data; and (2) the ability to recover lost data in the event of a system failure during data acquisition- This project will implement a scalable and crash-proof method that makes it possible, in real-time, to monitor data streamed at very high speeds and high volumes- Additionally, it will deliver tools to help users deploy the software and tune the software for their unique circumstances-