Split ingest into steps
Currently the data ingestion is made into one methoh ingest
- retrieve investigation, create it if not exists
- create dataset
- create datafiles
- create dataset parameters
- update dataset statistics
- update investigation statistics
- uploading into the gallery
- ...
we could split this method into different steps in camel context configuration, so if one step is failing, we could try to redeliver it for example, etc.
Workflow has to be defined, check how the created entities are deleted on failure.