https://forge.softwareheritage.org/source/swh-scheduler.git
Revision e785252c34b6f252144ac4eae00ccb1a793a3e7b authored by Antoine R. Dumont (@ardumont) on 29 March 2018, 08:47:08 UTC, committed by Antoine R. Dumont (@ardumont) on 29 March 2018, 10:32:37 UTC
Unfortunately, the bulk api does not return the full indexed data's
original source [1] (which we need to identify the data clean up in
the db).  So we leverage elasticsearch's multi-get api to read back
the original source.

Related T986
1 parent 4d13f5d
History
Tip revision: e785252c34b6f252144ac4eae00ccb1a793a3e7b authored by Antoine R. Dumont (@ardumont) on 29 March 2018, 08:47:08 UTC
swh.scheduler.cli: Use bulk api to index tasks
Tip revision: e785252
File Mode Size
bin
data
debian
docs
sql
swh
.gitignore -rw-r--r-- 67 bytes
AUTHORS -rw-r--r-- 112 bytes
LICENSE -rw-r--r-- 34.3 KB
LICENSE.Celery -rw-r--r-- 2.6 KB
MANIFEST.in -rw-r--r-- 91 bytes
Makefile -rw-r--r-- 163 bytes
requirements-swh.txt -rw-r--r-- 19 bytes
requirements.txt -rw-r--r-- 280 bytes
setup.py -rw-r--r-- 937 bytes

back to top