Skip to content

Add time to progress logging

Wout De Nolf requested to merge add_time_to_progress_logging into main

INFO logs during integration tasks that show the progress now also show time spend in reading, processing and writing

# limatake(0.001, 107123, save=True)
...
[2024-08-03 03:09:45,520: INFO/ForkPoolWorker-8] Integrated 12145 images of ? (ONGOING: process=00:00:25 (18%), write=00:00:00 (0%), read=00:01:51 (81%), TOTAL=00:02:16 (100%))
[2024-08-03 03:09:47,413: INFO/ForkPoolWorker-7] Integrated 33224 images of ? (ONGOING: process=00:01:02 (18%), write=00:00:01 (0%), read=00:04:48 (82%), TOTAL=00:05:51 (100%))
[2024-08-03 03:09:50,522: INFO/ForkPoolWorker-8] Integrated 12615 images of ? (ONGOING: process=00:00:26 (18%), write=00:00:00 (0%), read=00:01:55 (81%), TOTAL=00:02:21 (100%))
...
[2024-08-03 10:43:37,701: INFO/ForkPoolWorker-2] Integrated 107123 images of ? (FINISHED: process=00:03:29 (18%), write=00:00:04 (0%), read=00:15:20 (81%), TOTAL=00:18:53 (100%))

In addition this MR makes use of the context iterator of ewoksdata (release in 0.5.1).

Edited by Wout De Nolf

Merge request reports

Loading