Add ewoks tasks to replace sidecar worker
Closes #14 (closed)
- Makes the intermediate celery worker optional based on
CELERY_EWOKS_TASK_QUEUES
. IfCELERY_EWOKS_TASK_QUEUES
is empty everything is handled by the default queue - Add ewoks tasks for
StartJob
,EndJob
,ErrorHandler
,GetMetadata
, which allows creating anAutoProcProgram
and returning its id along with the related metadata. This allows most sidecar functionality to pass directly into ewoks (if wanted/needed) without the need for a specialised worker.
The single worker is still useful as it can capture the workflow execution output and automatically register the file as an AutoProcProgramAttachment
, as well as automatically inject graylog.
Edited by Stuart Fisher