Skip to content

Bug linking processed datasets

Depending on the order of the datasets, the ingester currently does not link the processed dataset correctly. Example in chronological order: image

But when they arrive randomly we got: image

How to reproduce:

#!/bin/bash

# RAW BUFFER BEFORE
icat-store-raw --beamline bm29 --proposal BLC16410 --dataset raw_buffer_before --sample sample2 --path /tmp/TEST1/buffer_before -p SAXS_experiment_type=sampleChanger -p SAXS_sample_type=buffer
sleep 10


# BUFFER BEFORE INTEGRATION
icat-store-processed --beamline bm29 --proposal BLC16410 --dataset integration_buffer_before --sample sample2 --path /tmp/TEST1/integration/buffer_before --raw /tmp/TEST1/buffer_before
sleep 5


# SUBTRACTION
icat-store-processed --beamline bm29 --proposal BLC16410 --dataset subtraction_sample_1 --sample sample2 --path /tmp/TEST1/subtraction/sample_1 --raw /tmp/TEST1/integration/buffer_before,/tmp/TEST1/integration/buffer_after,/tmp/TEST1/integration/sample1
sleep 5


# BUFFER AFTER RAW
icat-store-raw --beamline bm29 --proposal BLC16410 --dataset raw_buffer_after --sample sample2 --path /tmp/TEST1/buffer_after -p SAXS_experiment_type=sampleChanger -p SAXS_sample_type=buffer
sleep 5


# SAMPLE RAW
icat-store-raw --beamline bm29 --proposal BLC16410 --dataset sample1 --sample sample2 --path /tmp/TEST1/sample1 -p SAXS_experiment_type=sampleChanger -p SAXS_sample_type=sample
sleep 5


# SAMPLE INTEGRATION
icat-store-processed --beamline bm29 --proposal BLC16410 --dataset integration_sample --sample sample2 --path /tmp/TEST1/integration/sample1 --raw /tmp/TEST1/sample1
sleep 5


# BUFFER AFTER INTEGRATION
icat-store-processed --beamline bm29 --proposal BLC16410 --dataset integration_buffer_after --sample sample2 --path /tmp/TEST1/integration/buffer_after --raw /tmp/TEST1/buffer_after