https://forge.softwareheritage.org/source/swh-scheduler.git
Revision c92ead5875ecfd96a164eec1803398adec6eb8a8 authored by Nicolas Dandrimont on 21 January 2021, 16:31:43 UTC, committed by Valentin Lorentz on 26 January 2021, 12:20:39 UTC
The earlier implementation would just schedule new visits for origins
forever, regardless of whether they were already scheduled or not.
1 parent 2b39cbc
Raw File
Tip revision: c92ead5875ecfd96a164eec1803398adec6eb8a8 authored by Nicolas Dandrimont on 21 January 2021, 16:31:43 UTC
grab_next_visits: don't re-schedule visits too fast
Tip revision: c92ead5
requirements.txt
# Add here external Python modules dependencies, one per line. Module names
# should match https://pypi.python.org/pypi names. For the full spec or
# dependency lines, see https://pip.readthedocs.org/en/1.1/requirements.html

attrs
attrs-strict
celery >= 4.3, != 5.0.3
Click
elasticsearch > 5.4
flask
humanize
pika >= 1.1.0
psycopg2
pyyaml
setuptools
typing-extensions

# test dependencies
# hypothesis
back to top