Skip to content

NxtomoReader: read NXTomo files without DataUrls

Pierre Paleo requested to merge nxtomoreader into master

About

This MR is a tentative simplification of the data reading process for HDF5-NXTomo files.

Currently, ChunkReader uses a list of DataUrl to browse the files, which is cumbersome and inefficient.

NXTomoReader will load the data directly from entry/measurement/data (or simiar) and bypass the DataUrl collection.

To do

  • Base NXTomoReader
  • Advanced features
    • Arbitrary Sub-region
    • Read with read_direct()
    • Support on-the-fly processing function
  • Unit tests

Notes

When a processing function is passed, the memory usage can be up to twice bigger, since the reader does something like

    dptr = file_desc[data_path]
    dptr.read_direct(dst_buffer, source_sel=...)
    self.data = self.processing_function(dst_buffer)
Edited by Pierre Paleo

Merge request reports

Loading