pypushflow merge requestshttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests2021-01-06T16:42:50+01:00https://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/3add management of add-ons2021-01-06T16:42:50+01:00paynoadd management of add-onsGoal
----
Define and manage add-on to pypushflow.
/close #2
Info
----
This PR come with two add-on project:
- a project to explain add-on with an hello-world (https://gitlab.esrf.fr/workflow/ppfhelloworld)
- a function...Goal
----
Define and manage add-on to pypushflow.
/close #2
Info
----
This PR come with two add-on project:
- a project to explain add-on with an hello-world (https://gitlab.esrf.fr/workflow/ppfhelloworld)
- a functional add-on 'mongodb' to publish workflow execution on a mongodb database. (https://gitlab.esrf.fr/workflow/ppfmongodb)0.1https://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/1WIP: Include and manage 'representation'2020-04-02T14:45:07+02:00paynoWIP: Include and manage 'representation'The goal of this PR is to perform execution of workflows defined by 'representation' with pypushflow.
A prototype using an old version 'pypushflow' was done: representationtest/instanciation and might be use back (https://gitlab.esrf....The goal of this PR is to perform execution of workflows defined by 'representation' with pypushflow.
A prototype using an old version 'pypushflow' was done: representationtest/instanciation and might be use back (https://gitlab.esrf.fr/workflow/representationtest)
Regarding the actual source code we should answer several questions before modifications:
- Do we expect an application to execute any .ows or is this specific to the application using it (in this case pypushflow would be a library)
--> to start pypushflow will be a dependence of applications.
- Does the 'joinActor', 'ForkActor', 'RouterActor' be defined at the representation test or should they be deduced from the 'representation scheme' (for me it should be second way)
-->It doesn't have to be defined in the 'moml' / 'ows' but could be deduced from it. Should be in 'representation scheme' or in 'pypushflow'. Like a 'interpret Scheme' which will embed the new actors.
If embed in 'representation scheme' can be used by other tools.
- Do we agree to insure all communication between actors with (serializable) dictionaries ? Would we like at one point to have more complex / better performance connection ?
--> to see later
- Do we plan to 'move' the MongoDB part into an 'add-on' ?
--> yes, can / should be an add-on / plugin
- What are the scenarii and typical use case ?
- What should be the API
TODO list:
- [ ] define concrete scenarii and use case
- [ ] add some unittest
- [x] include representation in the project (/close #1)
- [ ] define clearly the user API
- [ ] add some tutorial
- [ ] add some documentation
- [ ] move mongodb part into an add-on (should be part of an other PR)0.1https://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/77fix CI2024-03-18T14:28:20+01:00Wout De Nolffix CIWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/76bump version2024-01-31T12:09:49+01:00Wout De Nolfbump versionWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/75Resolve "Mongo serializaion can fail"2024-01-31T11:56:33+01:00Wout De NolfResolve "Mongo serializaion can fail"Closes #21
This handles exceptions but in fact any unsupported type. We might run workflows that pass numpy arrays or anything else. This is now also supported.
I also added proper tests with `mongomock`.Closes #21
This handles exceptions but in fact any unsupported type. We might run workflows that pass numpy arrays or anything else. This is now also supported.
I also added proper tests with `mongomock`.Wout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/74Draft: Resolve "Mongo serializaion can fail"2024-01-30T21:55:27+01:00Wout De NolfDraft: Resolve "Mongo serializaion can fail"Closes #21Closes #21Wout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/73black2024-01-30T21:57:31+01:00Wout De NolfblackWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/72Allow downstream data override2023-09-30T17:16:56+02:00Wout De NolfAllow downstream data overrideWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/71bump version2023-09-07T11:57:58+02:00Wout De Nolfbump versionWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/70Resolve "Engine should re-raise the original exception"2024-01-30T17:57:53+01:00Wout De NolfResolve "Engine should re-raise the original exception"Closes #20Closes #20Wout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/69Resolve "Stopping a workflow: sometimes causes RuntimeError instead of Workfl...2023-06-05T08:39:47+02:00Wout De NolfResolve "Stopping a workflow: sometimes causes RuntimeError instead of WorkflowException"Closes #18Closes #18Wout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/68sphinx setuptools integration deprecated2023-06-02T11:19:06+02:00Wout De Nolfsphinx setuptools integration deprecatedWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/67Resolve "add "solo" concurrency"2024-03-18T14:29:04+01:00Wout De NolfResolve "add "solo" concurrency"Closes #17Closes #17Wout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/66docs: fix code block2023-03-26T10:52:35+02:00Wout De Nolfdocs: fix code blockWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/65docs: simplify pip and pytest2023-03-14T12:29:47+01:00Wout De Nolfdocs: simplify pip and pytesthttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/64black2023-02-01T14:33:56+01:00Wout De NolfblackWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/63ewoksci moved2023-02-01T14:17:08+01:00Wout De Nolfewoksci movedWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/62bump version2023-01-09T15:02:37+01:00Wout De Nolfbump versionWout De NolfWout De Nolfhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/61Issue #16: BES database refactoring2023-01-09T11:24:10+01:00Olof SvenssonIssue #16: BES database refactoringRefactoring of connection to BES MongoDB. I have tested the code on a new BES MongoDB installation.Refactoring of connection to BES MongoDB. I have tested the code on a new BES MongoDB installation.Olof SvenssonOlof Svenssonhttps://gitlab.esrf.fr/workflow/pypushflow/-/merge_requests/60Draft: fix tests on conda forge2022-12-07T17:43:04+01:00Wout De NolfDraft: fix tests on conda forgeWout De NolfWout De Nolf