Skip to content

Address simultaneous reconstruction in the same directory

Pierre Paleo requested to merge nxflatfield into master

About

This MR addresses the case where several datasets are reconstructed simultaneously from the same directory. In the current state of things, there will be "conflicts" in both nabu_processes.h5 and nabu.log.
Using unique entries in one single nabu_processes.h5 file won't solve the problem, as several HDF5 writers will attempt to write simultaneously in the same file (which is error-prone). Instead we use different filenames for each dataset.

To do

  • Rework NXFlatField API
  • Unit tests
  • Always write the data (close #190 (closed))
  • Ensure the nabu_processes.h5 file and/or entry is unique (close #194 (closed))
  • Integrate in pipeline
  • Create logger in ProcessConfig
  • Rename nabu.log to dataset_prefix_nabu.log
  • End-to-end reconstruction tests
Edited by Pierre Paleo

Merge request reports