The HDF Group

Logo


Got HDF5?

Visualization of an HDF5 file
Curious to see what’s inside? Try this
(This free tool will show you the contents of an HDF5 file in your browser, without any data leaving your computer! For more info, check out H5Web.)

*** Work-in-Progress ***

Advanced Topics in HDF5

Topic Description
Chunking in HDF5 Provides detailed information regarding chunking in HDF5
HDF5 File Image Operations (PDF) Describes how to work with HDF5 files in memory. Disk I/O is not required when file images are opened, created, read from, or written to
Copying Committed Datatypes with H5Ocopy (PDF) Describes how to copy to another file a dataset that uses a committed datatype or an object with an attribute that uses a committed datatype so that the committed datatype in the destination file can be used by multiple objects
Collective Metadata I/O Describes optimizing HDF5 by collecting metadata I/O
Enabling a Strict Consistency Semantics Model in Parallel HDF5 (PDF) Describes how to improve file access consistency semantics with the Parallel HDF5 library
File Space Management Describes mechanisms to manage space in an HDF5 file
Fine-tuning the Metadata Cache Describes how to provide better control of the metadata cache
Freeing Memory Allocated by the HDF5 Library (PDF) Describes how inconsistent memory management can cause heap corruption or resource leaks and possible solutions
HDF5 Data Flow Pipeline for H5Dread Describes data flow when reading raw data from an HDF5 dataset
HDF5 Metadata Provides a comprehensive overview of the types of metadata used in HDF5
Introduction to Single-Writer_Multiple-Reader (SWMR) Enables writing to a file while multiple readers are accessing it
Introduction to the Virtual Dataset - VDS Describes how to present data stored in several HDF5 datasets and files as a single dataset and access the data using HDF5 APIs
Modified Region Writes (PDF) Describes how to set write operations for in-memory files so that only modified regions are written to storage. Available when the Core (Memory) VFD is used
Page Buffering (PDF) Describes how to reduce the number of small accesses in HDF5 by buffering metadata and raw data accesses
Partial Edge Chunks Describes how to control the filtering of partial edge chunks to improve performance when extending datasets
Thread-safe HDF5 Information on thread-safety and concurrent access in HDF5
Using the Direct Chunk Write Function (PDF) Describes another way that chunks can be written to datasets
Virtual Object Layer An abstraction layer within the HDF5 library that enables different methods for accessing data and objects that conform to the HDF5 data model