Skip to main content

Browse the archive

https://forge.softwareheritage.org/source/swh-scheduler.git
13 March 2024, 03:48:39 UTC
Revision d58776ab0b41ccaf93cc64c86688712db5b44c07 authored by Antoine R. Dumont (@ardumont) on 22 July 2021, 10:22:24 UTC, committed by Nicolas Dandrimont on 22 July 2021, 10:23:44 UTC 
Introduce new scheduling policy to grab origins without last update
 
This is in charge of scheduling origins without last update. This also updates the
global queue position so the journal client can initialize correctly the next position
per origin and visit type.

Related to T2345
1 parent 825e8cf
Raw File
Tip revision: d58776ab0b41ccaf93cc64c86688712db5b44c07 authored by Antoine R. Dumont (@ardumont) on 22 July 2021, 10:22:24 UTC
Introduce new scheduling policy to grab origins without last update
Tip revision: d58776a
requirements.txt 
# Add here external Python modules dependencies, one per line. Module names
# should match https://pypi.python.org/pypi names. For the full spec or
# dependency lines, see https://pip.readthedocs.org/en/1.1/requirements.html

attrs
attrs-strict
celery >= 4.3, != 5.0.3
click
elasticsearch > 5.4
flask
humanize
pika >= 1.1.0
psycopg2
pyyaml
requests
setuptools
typing-extensions
back to top