Skip to content

Draft: Interleaved reading and processing

Pierre Paleo requested to merge interleaved_read_process into master

About

This MR adds interleaved reading and processing.

To do

  • Make it work for chunked mode
  • Make it work for grouped mode
  • End-to-end reconstruction test

Close #265

Notes

The main thing is to decouple reader from the rest of the pipeline, and still avoid extraneous memory allocations.

See #265 for a more detailed description of the approach

Merge request reports