Skip to main content

Browse the archive

https://forge.softwareheritage.org/source/swh-scheduler.git
13 March 2024, 03:48:39 UTC
Revision 58ca79622db077d9a2a897b4671a6013bf70f97d authored by Antoine R. Dumont (@ardumont) on 15 January 2021, 14:49:41 UTC, committed by Antoine R. Dumont (@ardumont) on 19 January 2021, 09:17:05 UTC 
journal_client: Improve stats detection
 
This adds an integration test which permutes input to ensure out of order renders the
same result.

This also improves the current algorithm which revealed some hit-and-miss cases:

- Initialization of the first visit detection (through the "last_snapshot" absence
  field, the previous implementation check could fail otherwise).

- out of order policy (ignore old event) in case of supposedly "eventful" event was done
  too early which ignored too much messages (those new test cases failed in some
  permutations). This is now specifically checked in case of referenced snapshots which
  led to cases of possibly changing eventful event into uneventful one. For example, the
  case of an anterior eventful event is caught which means that the current
  most-up-to-date eventful event is actually an uneventful one).

...

Related to T2967
1 parent d3afd14
History
Tip revision: 58ca79622db077d9a2a897b4671a6013bf70f97d authored by Antoine R. Dumont (@ardumont) on 15 January 2021, 14:49:41 UTC
journal_client: Improve stats detection
Tip revision: 58ca796
File Mode Size
data
docs
sql
swh
.gitignore -rw-r--r-- 129 bytes
.pre-commit-config.yaml -rw-r--r-- 1021 bytes
AUTHORS -rw-r--r-- 112 bytes
CODE_OF_CONDUCT.md -rw-r--r-- 3.3 KB
CONTRIBUTORS -rw-r--r-- 14 bytes
LICENSE -rw-r--r-- 34.3 KB
LICENSE.Celery -rw-r--r-- 2.6 KB
MANIFEST.in -rw-r--r-- 154 bytes
Makefile -rw-r--r-- 163 bytes
README.md -rw-r--r-- 292 bytes
conftest.py -rw-r--r-- 620 bytes
mypy.ini -rw-r--r-- 599 bytes
pyproject.toml -rw-r--r-- 237 bytes
pytest.ini -rw-r--r-- 33 bytes
requirements-swh.txt -rw-r--r-- 47 bytes
requirements-test.txt -rw-r--r-- 65 bytes
requirements.txt -rw-r--r-- 403 bytes
setup.cfg -rw-r--r-- 247 bytes
setup.py -rwxr-xr-x 2.3 KB
tox.ini -rw-r--r-- 673 bytes

README.md

back to top