Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • bliss bliss
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 544
    • Issues 544
    • List
    • Boards
    • Service Desk
    • Milestones
  • Jira
    • Jira
  • Merge requests 145
    • Merge requests 145
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • BlissBliss
  • blissbliss
  • Merge requests
  • !3437

Flint: Add watchdogs

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Valentin Valls requested to merge valentin.valls/bliss:add-watchdog-for-flint into master Feb 01, 2021
  • Overview 3
  • Commits 5
  • Pipelines 6
  • Changes 6

This MR introduce 2 watchdogs to allow to debug Flint and protect the beamline in production.

This have to be enabled using:

SCAN-DISPLAY.extra_args = ["--enable-watchdog"]

The first one can be triggered manually to be able to retrieve information when Flint is freezed.

kill -USR1 FLINT_PID   # 1st time: start monitoring
kill -USR1 FLINT_PID   # 2nd time: log monitoring

The second is a memory watchdog triggered according to the percentage of the memory used by Flint (the one displayed by top).

  • At 50% the monitoring is started
  • At 60% the data monitored is logged and it tries to close Flint
  • At 70% send a kill signal

Log results can be found in /var/log/bliss/flint_ with the name of the session.

Edited Feb 05, 2021 by Valentin Valls
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: add-watchdog-for-flint