Skip to content

Change compression from lzf to gzip

Thomas Vincent requested to merge tvincent/xsocs:compression into master

Merge MR !102 (merged) first.

This MR makes the HDF5 dataset compression settable through xsocs.config.DEFAULT_HDF5_COMPRESSION and change the used compression from lzf to gzip by default.

Merged file size is reduced and similar to input EDF.

Here is the results of the tests I made: EDF file: 37M Corresponding HDF5 file:

  • lzf: 101M
  • gzip with default compression level (4): 42M
  • gzip max compression level (9) slower: 35M lzf is expected to be faster, gzip compression with level 9 is slower than with level 4.

I kept the default compression level 4, but this can easily be made settable through xsocs-config if needed as for setting the compression algorithm.

closes #75 (closed)

Merge request reports