https://forge.softwareheritage.org/source/swh-scheduler.git

sort by:
Revision Author Date Message Commit Date
6cc6cb7 New upstream version 0.0.20 30 March 2018, 09:44:18 UTC
d6b393d swh.scheduler.cli.archive: By default, archive last month's data Related T986 29 March 2018, 15:32:25 UTC
e785252 swh.scheduler.cli: Use bulk api to index tasks Unfortunately, the bulk api does not return the full indexed data's original source [1] (which we need to identify the data clean up in the db). So we leverage elasticsearch's multi-get api to read back the original source. Related T986 29 March 2018, 10:32:37 UTC
4d13f5d swh.scheduler.cli.archive: Improve dry-run behavior Related T986 26 March 2018, 15:56:00 UTC
af4c9b8 swh.scheduler.cli.archive: Optimize reading task lookup query Related T986 26 March 2018, 15:32:57 UTC
d83da86 swh.scheduler.cli.archive: Remove unnecessary order by condition Related T986 22 March 2018, 16:39:13 UTC
bcb4f74 swh.scheduler.cli.archive: Open batch size option for index/cleanup Related T986 22 March 2018, 16:39:13 UTC
9e9f7ef swh.scheduler.cli.archive: Stream indexed tasks removal Related T986 22 March 2018, 15:51:03 UTC
e3867ed swh.scheduler.cli.archive: Fix edge case when reading tasks Related T986 22 March 2018, 15:50:07 UTC
b76384b swh.scheduler.cli: Open endpoint to archive tasks in elasticsearch Related T986 22 March 2018, 12:51:48 UTC
8435efd swh.scheduler.cli: Add sql function to list archivable tasks Related T986 Related P240 21 March 2018, 18:58:45 UTC
0324fb2 sql/data: Fix missing num_retries in deposit task types 15 March 2018, 10:21:06 UTC
367ab15 swh.core.serializer: Move to msgpack serialization format This permits to serialize bytes which was an existing behavior in celery 3.1 (when pickle was the default format). Related T782 Related D300 14 March 2018, 12:31:59 UTC
a474ed5 swh.scheduler.cli: Unify pretty print output 09 March 2018, 15:56:03 UTC
0e8e237 sql/data: Add new task type for loading mercurial dump 09 March 2018, 15:54:32 UTC
5a70627 swh.scheduler.cli: Add sample use case for the scheduling cli 09 March 2018, 15:54:32 UTC
3d68f20 swh.scheduler.cli: Open policy column to the scheduling cli 09 March 2018, 15:54:31 UTC
185f4b3 swh.scheduler.cli: Open the delimiter option as cli argument When providing json values (args|kwargs column), csv's default comma separator and json's default separator values clash. So the cli fails to schedule task. This commit permits to overcome that issue by providing the delimiter ';' to the cli call when json is required. 09 March 2018, 15:52:49 UTC
4b918af Fix issue when updating task-type without any retry delay defined Related P231 Related T902 08 March 2018, 10:27:47 UTC
f8ddae1 Fix pep8 violation regarding bare except 08 March 2018, 10:27:26 UTC
46329da swh-scheduler/data: Add new oneshot scheduling load-mercurial task Related T908 19 December 2017, 13:37:59 UTC
b74c89f backend: fix default scheduling_db value for consistency 14 December 2017, 17:26:59 UTC
5b17566 backend: doc: fix return value of create_tasks 14 December 2017, 16:53:30 UTC
f08d9e7 Reference new task_type in scheduler 07 December 2017, 14:18:31 UTC
11ec4ba New upstream version 0.0.19 29 November 2017, 11:51:15 UTC
255d851 swh.scheduler.utils: Open utility function to create oneshot task 29 November 2017, 11:30:35 UTC
cb7d5fa New upstream version 0.0.18 08 November 2017, 16:06:22 UTC
723221e Update for celery 4 08 November 2017, 16:00:50 UTC
09b82c9 docs: add absolute anchor to documentation index 02 November 2017, 10:09:25 UTC
926cb2e New upstream version 0.0.17 12 October 2017, 16:49:02 UTC
cd827b6 Add missing __init__.py files 12 October 2017, 16:48:15 UTC
0a3d8ec Cleanup packaging 12 October 2017, 15:17:55 UTC
79b0ccd swh.scheduler.cli: Fix missing task type option 11 October 2017, 08:57:49 UTC
d5f2d51 sql/updates/06: add name to check constraint 11 September 2017, 12:10:41 UTC
73f4aee sql: one-shot tasks don't really have an interval 11 September 2017, 12:06:56 UTC
b4bbc05 sanitize docstrings for sphinx 06 September 2017, 18:45:30 UTC
ca0230d sql: clean up schema syntax issues 01 September 2017, 18:21:29 UTC
f785a81 docs/: add sphinx apidoc generation skeleton change cherry picked from python module template commit 71b117ba0cf9f1251b1cac26d0994df03a4c787d 30 August 2017, 10:26:02 UTC
89625c1 updates/05: fix SQL syntax to let the update run 20 August 2017, 02:58:55 UTC
017c885 New upstream version 0.0.16 07 August 2017, 16:44:03 UTC
ee545d4 test_scheduler: add missing db attribute to database tests 07 August 2017, 16:43:57 UTC
deb40f2 requirements: bump swh.core to 0.0.34 07 August 2017, 16:33:54 UTC
8348905 sql: add update script from 04 to 05 07 August 2017, 16:07:30 UTC
3194c2b sql: new logic for recurrence of one-shot tasks 25 July 2017, 16:49:17 UTC
030a51f sql: add the recurrence policy to tasks and related fields to task_type This is the groundwork for the implementation of T720: - it adds the minimal set of fields required to allow for a task to be retried on transient failures; - it adds knowledge of whether a task is one-shot or recurring 25 July 2017, 15:44:40 UTC
adb5afe test_scheduler: more generic tests wrt task types 25 July 2017, 13:30:48 UTC
31a6697 celery_backend.runner: respect the task's maximum queue length Close T726 25 July 2017, 12:39:26 UTC
a0420b0 backend: Add max queue length to task types One more stepping stone towards T726 21 July 2017, 16:57:18 UTC
4fe37f7 backend: add get_tasks method 21 July 2017, 14:09:55 UTC
5ccc579 backend: add task_type argument to peek/grab_ready_tasks 21 July 2017, 13:58:35 UTC
af220e2 backend: add tests for grab_ready_tasks 19 July 2017, 18:02:11 UTC
d8945ae backend: add peek_ready_tasks tests 19 July 2017, 14:39:42 UTC
d74d79f tests: add create_tasks test 19 July 2017, 12:10:21 UTC
0b88b14 backend: add get_task_types 19 July 2017, 10:08:30 UTC
2e2205c tests: refactor and extend 19 July 2017, 10:07:01 UTC
d4eb07e Add test infrastructure for the scheduler backend 17 July 2017, 17:31:19 UTC
285e7b5 Add sql Makefile 17 July 2017, 17:04:32 UTC
5fa3510 New upstream version 0.0.15 19 June 2017, 17:44:56 UTC
0e14eff celery_backend.config: add a shortcut to get a queue length 19 June 2017, 17:00:18 UTC
7caf543 celery_backend.config: add a method to get queue statistics from RabbitMQ First part of implementing T726 19 June 2017, 14:03:19 UTC
54bcdda swh-worker-control: remove spurious print 19 June 2017, 09:51:39 UTC
80851f5 celery: enable console logging on debug loglevel 15 June 2017, 15:13:22 UTC
2d8f636 New upstream version 0.0.14 12 June 2017, 15:50:31 UTC
7c1c041 listener: update for the new task-result event 12 June 2017, 15:49:58 UTC
d3abfa4 listener: derive the reliable events receiver from the base celery class 12 June 2017, 15:49:12 UTC
671a2c0 task: move run to run_task to allow overriding the default behavior of tasks This is an API break, but it's just a matter of renaming all existing tasks to run_task instead of run. Close T536 12 June 2017, 13:30:02 UTC
07ea766 swh-worker-control: read the remote monotonic time to get task start times 31 May 2017, 16:27:53 UTC
c02757c celery_backend: add a remote-control command to get the monotonic clock 31 May 2017, 16:27:00 UTC
324a3cc bin/swh-worker-control: add command-line interface for worker remote control 31 May 2017, 15:51:04 UTC
4aaf546 New upstream version 0.0.13 07 April 2017, 09:57:50 UTC
f758291 requirements-swh.txt: use proper syntax 07 April 2017, 09:57:36 UTC
a760866 d/copyright: cleanup 07 April 2017, 09:53:08 UTC
35997f8 celery_backend.config: use the JournalHandler for logging 07 April 2017, 09:52:27 UTC
debb3a6 New upstream version 0.0.12 09 March 2017, 10:12:45 UTC
aaa5dfd celery_backend.config: only log to database if log_db is present 09 March 2017, 10:12:09 UTC
0767b4c requirements.txt: ensure we use celery<4 (we don't support other versions for now) 15 February 2017, 14:23:52 UTC
7fbd090 New upstream version 0.0.11 14 February 2017, 18:49:34 UTC
6192ac1 Add utils.get_task fn to simplify contextual task instance retrieval Permits to unify the task instance retrieval, which then permits to send messages to the associated task's queue. 10 February 2017, 14:11:54 UTC
1aedc67 requirements: split internal and external requirements in two separate files 09 February 2017, 13:32:06 UTC
d65742e celery_backend: pep8: fix missing blank lines 09 February 2017, 11:21:23 UTC
05f41c2 sql: fix default_interval selection for new tasks 21 October 2016, 14:09:11 UTC
faa3439 New upstream version 0.0.10 20 October 2016, 15:20:16 UTC
b048926 backend: the status of a task is task.status, not task.task_status... 20 October 2016, 14:02:57 UTC
da7b1b7 backend: allow disabling tasks 19 October 2016, 13:39:05 UTC
0fb8eef Fix docstring typo 05 September 2016, 12:27:28 UTC
9fb45f5 New upstream version 0.0.9 02 September 2016, 15:09:17 UTC
51cb666 celery_backend.config: add SWH_WORKER_INSTANCE environment variable This allows to run several workers with different configuration files. 01 September 2016, 15:23:15 UTC
cf55f87 New upstream version 0.0.7 01 July 2016, 14:42:45 UTC
811718b Just use default date of insertion to sort and reschedule job 01 July 2016, 13:29:51 UTC
ae202d1 Permit to schedule oneshot tasks 29 June 2016, 17:54:55 UTC
596bfda New upstream version 0.0.6 24 February 2016, 17:46:57 UTC
dced5d5 celery_backend.config: Put pickle last in the accepted encodings 24 February 2016, 15:36:52 UTC
7d6e331 backend: allow for mass-scheduling of task runs This allows the runner to be (~10 times) more efficient when running tasks 24 February 2016, 15:36:02 UTC
05c5f9d New upstream version 0.0.5 24 February 2016, 11:13:38 UTC
15c3d8f backend: use copy for mass-scheduling of tasks 24 February 2016, 11:10:51 UTC
ec0a71c New upstream version 0.0.4 23 February 2016, 16:46:04 UTC
4886edf Add cli to setup.py 23 February 2016, 16:08:46 UTC
f390dec cli: New command-line interface based on Click 23 February 2016, 16:06:13 UTC
77bcb2a backend: allow overriding the config at instantiation 23 February 2016, 16:06:13 UTC
35edc1a backend: use arrow instead of dateutil 23 February 2016, 16:04:33 UTC
back to top