HDF5

What is HDF5?

HDF5, or Hierarchical Data Format v.5, is a custom file system application that utilizes szip to better handle large and heterogenous data regardless of operating system.

How is HDF5 loaded?

The below can be used to view all of the installations of HDF5 on a particular system, where this example uses Coeus.

$ module avail |& grep -i "hdf5"

General/hdf5/1.10.1/gcc-6.3.0

How is HDF5 used?

The full HDF5 API can be seen here.

To easily use HDF5 with Python, utilize Python's h5py package to easily store and manipulate the data (more on that here).