Search

Help

Page 1 of 72. Showing 720 results (0.021 seconds)

  1. Why are my files sizes different, if I open an HDF5 file more than once rather than writing the data out in one call?

    to be wasted in the file because the library doesn't currently remember the free space in the file from one file open to the next. The threshold block size … / Setting the block size to zero should really only be used when small amounts of metadata are being added each time the file is opened. Setting the block size
    HDF Knowledge BaseJun 29, 2017
  2. Things that can affect performance

    , for detailed information regarding the use of chunking. Some things that may help are listed below: There is a chunk cache for each open dataset. The default size for this chunk cache is 1 MB. If there are a lot of chunked datasets left open, a large amount of memory may be used. It can help to reduce the size
    HDF Knowledge BaseApr 09, 2019
  3. Chunking in HDF5

    . In this way, a program can switch between using chunked and contiguous datasets by simply altering that call. Example 1, below, creates a dataset with a size of 12x12 and a chunk size of 4x4. The example could be changed to create a contiguous dataset instead by simply commenting out the call to H5Psetchunk and changing
    HDF5Feb 11, 2019
  4. H5P_SET_CHUNK_CACHE

    on daplid and the parameter will come from the file access property list used to open the file. sizet rdccnbytes IN: The total size of the raw data chunk cache … by H5PSETCHUNKCACHE . In the absence of any cache settings, H5DOPEN will by default create a 1 MB chunk cache for the opened dataset. If this size happens
    HDF5Jul 29, 2019
  5. TechNote-HDF5-ImprovingIOPerformanceCompressedDatasets.pdf

    .......................................................................................................................... 15 4.1. Adjust Chunk Cache Size .................................................................................................................. 15 4.1.1. How to Adjust the Chunk Cache Size
  6. TechNote-HDF5-ImprovingIOPerformanceCompressedDatasets.pdf

    .......................................................................................................................... 15 4.1. Adjust Chunk Cache Size .................................................................................................................. 15 4.1.1. How to Adjust the Chunk Cache Size
    HDF5 / … / HDF5 Compression TroubleshootingApr 09, 2018
  7. TechNote-HDF5-ImprovingIOPerformanceCompressedDatasets.pdf

    .......................................................................................................................... 15 4.1. Adjust Chunk Cache Size .................................................................................................................. 15 4.1.1. How to Adjust the Chunk Cache Size
  8. TechNote-HDF5-ImprovingIOPerformanceCompressedDatasets.pdf

    .......................................................................................................................... 15 4.1. Adjust Chunk Cache Size .................................................................................................................. 15 4.1.1. How to Adjust the Chunk Cache Size
    HDF5 / … / HDF5 Application Developer's GuideJan 24, 2018
  9. Direct Chunk Read and Write Questions

    that the size of "buf" is/should be the size of the chunk (and therefore should be redundant to provide it)? Otherwise, what are the implications of defining a value for "datasize" lower and greater than the size of the chunk? If buf is filtered, the buffer size will not be computable from the datasize parameter. Can
    HDF Knowledge BaseJun 17, 2020
  10. 20200206_ECPTutorial-final.pdf

    (e.g., use chunking storage) – Access properties (e.g., using MPI I/O driver to access file) • Object is opened or created – Creation properties applied – Access … https://portal.hdfgroup.org/display/HDF5/ChunkinginHDF5 and consider – Do you access the same chunk often? – What is the best chunk size (especially when using compression)? – Do you need to adjust
    HDF5 / … / Parallel HDF5Oct 12, 2020