https://forge.softwareheritage.org/source/swh-scheduler.git
Revision 962fd8b55e29456b4a1dc1573a6ed908d9ddc6b5 authored by Antoine R. Dumont (@ardumont) on 10 April 2018, 12:42:35 UTC, committed by Antoine R. Dumont (@ardumont) on 10 April 2018, 13:55:38 UTC
Prior to this commit, an error would raise and stop all indexation.
As the code is already waiting for a tuple (operation-status, item),
we instead leverage this and continue working on indexation.

All items whose `operation-status` is False (meaning failure to index,
whatever the reason) is not indexed.  Another run would then pickup
the leftover and index it.

Related T986
1 parent 9b9b88c
History
Tip revision: 962fd8b55e29456b4a1dc1573a6ed908d9ddc6b5 authored by Antoine R. Dumont (@ardumont) on 10 April 2018, 12:42:35 UTC
swh.scheduler.backend_es: Return operation failure instead of raising
Tip revision: 962fd8b
File Mode Size
bin
data
debian
docs
sql
swh
.gitignore -rw-r--r-- 67 bytes
AUTHORS -rw-r--r-- 112 bytes
LICENSE -rw-r--r-- 34.3 KB
LICENSE.Celery -rw-r--r-- 2.6 KB
MANIFEST.in -rw-r--r-- 91 bytes
Makefile -rw-r--r-- 163 bytes
requirements-swh.txt -rw-r--r-- 19 bytes
requirements.txt -rw-r--r-- 284 bytes
setup.py -rw-r--r-- 937 bytes

back to top