Page tree

Does HDF5 support compression with parallel HDF5

As of version 1.10.2, HDF5 supports parallel compression. With this release, parallel applications can create and write to compressed datasets (or datasets with filters applied, such as Fletcher32-bit).

Prior to that, you could read compressed data in parallel, but not write.

The "Parallel Filtered Dataset Writes" flag was added to the libhdf5.settings file to indicate whether or not parallel compression is supported in a built HDF5 library.