The Highly Scalable Data Service (HSDS) is a server-based application that facilitates quick and cost-effective access to large collections of HDF5-encoded data remotely stored in the cloud (e.g. Amazon S3). HSDS can slice through HDF5 files without the need to download the entire file locally. This results in greater performance and cost benefits. In addition, HSDS allows developers to use a new REST API and command line interface OR existing h5py and library SDK (e.g. C/C++) to seamlessly read and write HDF5 files in the cloud.
You can use HSDS through any of three commercial products:
- HDF Lab, a hosted, JupyterLabs-enabled data exploration
- HSDS Azure VM
Learn more about HDF Lab's architecture.