... | ... | @@ -67,18 +67,44 @@ Architecture for Lima 3 |
|
|
|
|
|
After last discussion Alejandro and Sebastien proposed two different approaches.
|
|
|
|
|
|
Seb: A Distributed Lima with 2 stages
|
|
|
Seb: Distributed Lima with clear separation of acquisition and processing stages
|
|
|
-------------------------------------
|
|
|
- back-end stage (acquisition) should manage balancing of images or part of images on several computers to a storage area
|
|
|
- front-end stage (processing) should manage ready images for further processing
|
|
|
- front-end stage (acquisition) should manage balancing of images or part of images on several computers to a storage area
|
|
|
- back-end stage (processing) should manage ready images for further processing
|
|
|
|
|
|
Pros:
|
|
|
|
|
|
Cons:
|
|
|
|
|
|
Alejandro: A Distributed Lima single stage
|
|
|
Alejandro: Distributed Lima with mixed acquisition and processing stages
|
|
|
-------------------------------------------
|
|
|
Both acquisition and processing should be manage as a single stage as it is today.
|
|
|
The proposed approach is based in the following principles:
|
|
|
|
|
|
* Lima manages the 2D data acquisition as well as software processing
|
|
|
* Offering an optimum use of software resources
|
|
|
* Some modern detectors cannot be managed by a single back-end computer
|
|
|
* Multiple back-end computers are needed for data acquisition and/or processing
|
|
|
|
|
|
In addition, Lima v2 is expected to provide:
|
|
|
|
|
|
* Explicit separation between data acquisition and data processing dynamics
|
|
|
* Data processing management must provide a flexible way to control (parallel) tasks at different speeds
|
|
|
* Extended API for multiple data saving streams
|
|
|
|
|
|
Two main topologies have been identified in the cases needing multi-backend Lima:
|
|
|
|
|
|
1) Distributed-geometry: A detector composed by aggregated modules can be connected to several computers, each receiving all the frames from a sub-set of modules
|
|
|
|
|
|
2) Distributed-frames: The detector is connected to multiple computers, either directly or through a switching network, being able to dispatch full frames to individual computers, alternating the destination computer with a load-balancing arbitration
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
The software processing plugin API will need to be extended to:
|
|
|
|
|
|
* API for distributed readout of (potentially) intermediate streams
|
|
|
|
|
|
|
|
|
Pros:
|
|
|
|
... | ... | |