Skip to content

Datanode reduce redis keys calls

Wout De Nolf requested to merge datanode_reduce_redis_keys_calls into master

Refactor Redis DataNode walking: reduce stress on the Redis server (due to searching Redis keys) at the expense of increasing the delay between event publishing and receiving (seems not noticeable in practise).

The Redis KEYS command is used by:

  • DataNode.walk_new_events: 1 KEYS call
  • DataNode.walk_from_last: 1 KEYS call

As a result we have 1 KEYS call when:

  • starting the BLISS shell with tmux (F5 bliss.shell.data.display.ScanDataListener)
  • starting Flint
  • starting the Nexus writer (1 writer per session)
Edited by Wout De Nolf

Merge request reports