| 5f616b8 | Antoine R. Dumont (@ardumont) | 19 September 2018, 17:56:33 UTC | sql/data: Use the same max queue length as production | 19 September 2018, 17:56:33 UTC |
| 53c8225 | Stefano Zacchiroli | 19 September 2018, 15:19:21 UTC | use /usr/bin/env python3 as shebang, to be nice to virtualenv | 19 September 2018, 15:19:21 UTC |
| 4f51996 | Stefano Zacchiroli | 15 September 2018, 12:19:30 UTC | requirements.txt: add spaces around dep expression as we do everywhere else purely cosmetic change | 15 September 2018, 12:21:08 UTC |
| 218726d | Antoine R. Dumont (@ardumont) | 14 September 2018, 12:53:05 UTC | sql/scheduler-data: Normalize PyPI name for loader task | 14 September 2018, 12:53:05 UTC |
| 62331cf | Antoine R. Dumont (@ardumont) | 14 September 2018, 11:31:04 UTC | sql/scheduler-data: Normalize PyPI name Related T422 | 14 September 2018, 11:31:04 UTC |
| f088066 | Antoine R. Dumont (@ardumont) | 13 September 2018, 23:17:21 UTC | swh-scheduler-data: Update loader pypi backend_name task | 13 September 2018, 23:37:54 UTC |
| c4696cd | Antoine R. Dumont (@ardumont) | 03 August 2018, 08:37:26 UTC | sql/swh-scheduler-data: Reference the origin-update-pypi task type | 03 August 2018, 08:37:26 UTC |
| 458d604 | Antoine R. Dumont (@ardumont) | 01 August 2018, 08:56:30 UTC | sql/swh-scheduler-data: Reference pypi lister task | 01 August 2018, 08:56:30 UTC |
| 2a1b5d5 | Antoine R. Dumont (@ardumont) | 01 August 2018, 08:55:43 UTC | sql/swh-scheduler-data: Fix missing space tabulation | 01 August 2018, 08:55:43 UTC |
| 0bf3f70 | Antoine R. Dumont (@ardumont) | 31 July 2018, 04:55:39 UTC | New upstream version 0.0.31 | 31 July 2018, 04:55:39 UTC |
| 1c2899c | Antoine R. Dumont (@ardumont) | 30 July 2018, 16:14:11 UTC | sql/swh-scheduler: Make the create_tasks call idempotent + tests ok The tests were ko due to a missing step of mine (rebuilding the schema). Fortunately, this was not yet deployed. | 30 July 2018, 16:23:46 UTC |
| e4dd0a1 | Antoine R. Dumont (@ardumont) | 27 July 2018, 15:08:16 UTC | sql/swh-scheduler: Make the create_tasks call idempotent This in effect returns all rows associated with the tasks asked for creation (the input). If tasks were already created, we only return them. If they were not created, we create and return them. | 27 July 2018, 15:26:06 UTC |
| 9140960 | Antoine R. Dumont (@ardumont) | 27 July 2018, 11:48:28 UTC | swh.scheduler.utils: Open create_task_dict function | 27 July 2018, 11:48:28 UTC |
| 6e33cc7 | Antoine R. Dumont (@ardumont) | 19 July 2018, 09:21:21 UTC | sql/scheduler-data: Fix gitlab task type typos Related T1151 | 19 July 2018, 09:21:21 UTC |
| b0e03a7 | Antoine R. Dumont (@ardumont) | 18 July 2018, 16:26:49 UTC | sql/scheduler-data: Add lister gitlab task types Related T1151 | 18 July 2018, 16:28:47 UTC |
| a8271e9 | Antoine R. Dumont (@ardumont) | 18 July 2018, 16:20:27 UTC | sql/scheduler-data: Reference the existing production lister data | 18 July 2018, 16:20:27 UTC |
| fd1db01 | Antoine R. Dumont (@ardumont) | 28 June 2018, 08:44:05 UTC | swh.scheduler.backend_es: Open sniffing options | 28 June 2018, 08:45:35 UTC |
| ff4bce3 | Antoine R. Dumont (@ardumont) | 22 June 2018, 16:07:02 UTC | New upstream version 0.0.30 | 22 June 2018, 16:07:02 UTC |
| fc8c8d6 | Antoine R. Dumont (@ardumont) | 22 June 2018, 12:12:55 UTC | swh-scheduler-schema.sql: Archive disabled oneshot tasks as well | 22 June 2018, 16:06:04 UTC |
| 3795fde | Antoine R. Dumont (@ardumont) | 31 May 2018, 13:12:18 UTC | swh.scheduler.cli: Add policy to pretty printing task routine | 31 May 2018, 13:12:18 UTC |
| db0d47a | Antoine R. Dumont (@ardumont) | 31 May 2018, 13:07:28 UTC | swh.scheduler.cli: Fix broken cli list-pending since api change | 31 May 2018, 13:07:44 UTC |
| f413d93 | Antoine R. Dumont (@ardumont) | 31 May 2018, 09:42:51 UTC | New upstream version 0.0.29 | 31 May 2018, 09:42:51 UTC |
| 8bbbe7b | Antoine R. Dumont (@ardumont) | 31 May 2018, 09:37:04 UTC | swh.scheduler.cli: Change archival period to rolling month - 1 week This will permit a time window of 1 week to check everything is going smoothly in the scheduler db. Related T1031 Close T986 | 31 May 2018, 09:42:21 UTC |
| 05c64c0 | Antoine R. Dumont (@ardumont) | 30 May 2018, 18:28:43 UTC | swh.scheduler.updater.writer: Force filter resolution to list | 30 May 2018, 18:29:05 UTC |
| c4dd3c8 | Antoine R. Dumont (@ardumont) | 30 May 2018, 18:28:17 UTC | swh.scheduler.cli: Change default archival period to current month | 30 May 2018, 18:28:17 UTC |
| d0f7e94 | Antoine R. Dumont (@ardumont) | 30 May 2018, 14:18:11 UTC | swh.scheduler.cli: Improve logging message | 30 May 2018, 14:18:11 UTC |
| 7e03d80 | Antoine R. Dumont (@ardumont) | 30 May 2018, 14:17:44 UTC | swh.scheduler.updater.backend: Adapt configuration path accordingly | 30 May 2018, 14:17:44 UTC |
| 1b652ed | Antoine R. Dumont (@ardumont) | 29 May 2018, 12:12:15 UTC | New upstream version 0.0.28 | 29 May 2018, 12:12:15 UTC |
| 9f41ce3 | Antoine R. Dumont (@ardumont) | 29 May 2018, 12:11:07 UTC | packaging: Remove hypothesis as a runtime dependencies | 29 May 2018, 12:11:07 UTC |
| 8fd3bd7 | Antoine R. Dumont (@ardumont) | 29 May 2018, 10:27:34 UTC | New upstream version 0.0.27 | 29 May 2018, 10:27:34 UTC |
| cde2def | Antoine R. Dumont (@ardumont) | 29 May 2018, 10:08:41 UTC | packaging: Remove .hypothesis folder | 29 May 2018, 10:26:22 UTC |
| 7b45010 | Antoine R. Dumont (@ardumont) | 29 May 2018, 10:00:04 UTC | packaging: Fix tests in packaging | 29 May 2018, 10:26:22 UTC |
| a864649 | Antoine R. Dumont (@ardumont) | 29 May 2018, 09:36:32 UTC | packaging: Fix python3-swh.scheduler.updater tests package | 29 May 2018, 10:26:22 UTC |
| 1bdfaf1 | Antoine R. Dumont (@ardumont) | 29 May 2018, 09:22:40 UTC | d/control: Add new python3-swh.scheduler.updater package | 29 May 2018, 10:26:22 UTC |
| 5e56731 | Antoine R. Dumont (@ardumont) | 29 May 2018, 09:22:22 UTC | d/control: Fix runtime dependency version | 29 May 2018, 09:22:22 UTC |
| 58352e2 | Antoine R. Dumont (@ardumont) | 28 May 2018, 14:46:43 UTC | swh.scheduler.updater.writer: Add tests around writer | 28 May 2018, 14:57:35 UTC |
| 09e028e | Antoine R. Dumont (@ardumont) | 28 May 2018, 14:45:37 UTC | swh.scheduler.updater.backend: Make the reading timestamp optional | 28 May 2018, 14:46:07 UTC |
| 9def570 | Antoine R. Dumont (@ardumont) | 28 May 2018, 14:45:10 UTC | swh.scheduler.updater.writer: Do not set the limit at this level | 28 May 2018, 14:45:10 UTC |
| c288da2 | Antoine R. Dumont (@ardumont) | 28 May 2018, 09:34:05 UTC | swh.scheduler.updater.writer: Write tasks in batch Also, make the writer stops when no more data to write | 28 May 2018, 09:34:05 UTC |
| ab844be | Antoine R. Dumont (@ardumont) | 25 May 2018, 13:57:38 UTC | swh-scheduler: Fill in the blanks between priority tasks Related T1035 Related T1031 | 25 May 2018, 15:21:09 UTC |
| 378d23b | Antoine R. Dumont (@ardumont) | 25 May 2018, 08:33:38 UTC | data/elastic-template.json: Use 1 shard for the swh-tasks index | 25 May 2018, 08:33:38 UTC |
| d925b05 | Antoine R. Dumont (@ardumont) | 25 May 2018, 07:40:10 UTC | swh.scheduler.backend: Drop duplicate tasks at creation time Related T1031 Related T1051 | 25 May 2018, 07:41:27 UTC |
| 3f02cc3 | Antoine R. Dumont (@ardumont) | 24 May 2018, 09:50:46 UTC | swh.scheduler.api.client: Permit to specify the query timeout option Related T1061 | 25 May 2018, 07:41:27 UTC |
| 2b660ca | Antoine R. Dumont (@ardumont) | 23 May 2018, 13:59:38 UTC | swh.scheduler.backend: Add missing type cast | 23 May 2018, 13:59:38 UTC |
| 455f6d4 | Antoine R. Dumont (@ardumont) | 23 May 2018, 13:59:21 UTC | swh.scheduler.updater.writer: Remove noqa statement | 23 May 2018, 13:59:21 UTC |
| 56ce0f0 | Antoine R. Dumont (@ardumont) | 23 May 2018, 12:40:34 UTC | swh.scheduler.celery_backend.runner: Read more oneshot tasks | 23 May 2018, 12:40:34 UTC |
| 801d8e2 | Antoine R. Dumont (@ardumont) | 23 May 2018, 12:40:11 UTC | swh.scheduler.updater.writer: Sleep in between read/write cycle | 23 May 2018, 12:40:11 UTC |
| 3b0d71b | Antoine R. Dumont (@ardumont) | 23 May 2018, 12:39:29 UTC | swh.scheduler.updater.writer: Reuse oneshot task dict creation api | 23 May 2018, 12:39:29 UTC |
| 6980dbb | Antoine R. Dumont (@ardumont) | 23 May 2018, 12:07:00 UTC | swh.scheduler.updater.writer: Add configuration docstring | 23 May 2018, 12:07:35 UTC |
| 142f77d | Antoine R. Dumont (@ardumont) | 23 May 2018, 08:17:46 UTC | swh.scheduler.updater: Rename appropriately rate to cnt | 23 May 2018, 08:35:44 UTC |
| a06c20b | Antoine R. Dumont (@ardumont) | 22 May 2018, 16:17:13 UTC | swh.scheduler.updater.sql: Add first_seen column | 22 May 2018, 16:17:13 UTC |
| 070e516 | Antoine R. Dumont (@ardumont) | 22 May 2018, 15:09:37 UTC | swh.scheduler.updater.writer: Update variable names appropriately | 22 May 2018, 15:09:37 UTC |
| eeb5d77 | Antoine R. Dumont (@ardumont) | 18 May 2018, 16:17:17 UTC | swh.scheduler.updater.writer: Bootstrap the scheduler updater writer | 18 May 2018, 16:17:17 UTC |
| 33bc608 | Antoine R. Dumont (@ardumont) | 18 May 2018, 11:13:21 UTC | swh.scheduler.updater: Reference the origin's type | 18 May 2018, 11:29:30 UTC |
| 7b0c316 | Antoine R. Dumont (@ardumont) | 18 May 2018, 09:38:07 UTC | swh.scheduler.updater.ghtorrent: Don't open too many channels | 18 May 2018, 09:39:07 UTC |
| c7d17a5 | Antoine R. Dumont (@ardumont) | 18 May 2018, 09:37:47 UTC | swh.scheduler.updater.events: Fix event's __str__ implementation | 18 May 2018, 09:39:07 UTC |
| 7642339 | Antoine R. Dumont (@ardumont) | 18 May 2018, 09:37:40 UTC | swh.scheduler.updater.consumer: Make the logging actually log | 18 May 2018, 09:39:07 UTC |
| 8e0a169 | Antoine R. Dumont (@ardumont) | 18 May 2018, 08:43:27 UTC | swh.scheduler.updater.ghtorrent: Explicit interesting event keys | 18 May 2018, 08:45:43 UTC |
| 8e39b42 | Antoine R. Dumont (@ardumont) | 18 May 2018, 08:43:02 UTC | swh.scheduler.tests.updater: Reuse code in mixin | 18 May 2018, 08:45:43 UTC |
| 8add41c | Antoine R. Dumont (@ardumont) | 18 May 2018, 08:30:01 UTC | swh.scheduler.updater.consumer: Improve event management | 18 May 2018, 08:30:01 UTC |
| 2aa60e0 | Antoine R. Dumont (@ardumont) | 18 May 2018, 08:21:10 UTC | swh.scheduler.updater.consumer: Use logging instead of print | 18 May 2018, 08:21:10 UTC |
| ff65e77 | Antoine R. Dumont (@ardumont) | 17 May 2018, 14:07:53 UTC | swh.scheduler.updater.ghtorrent: Remove scratch code | 17 May 2018, 14:10:36 UTC |
| f2b0500 | Antoine R. Dumont (@ardumont) | 17 May 2018, 13:52:56 UTC | swh.scheduler.updater.consumer: Test consumer interface | 17 May 2018, 14:10:36 UTC |
| 24a887e | Antoine R. Dumont (@ardumont) | 17 May 2018, 12:38:18 UTC | swh.scheduler.updater.ghtorrent: Test ghtorrent implementation | 17 May 2018, 14:06:04 UTC |
| e281091 | Antoine R. Dumont (@ardumont) | 17 May 2018, 12:37:51 UTC | swh.scheduler.updater.ghtorrent: Simplify connection setup | 17 May 2018, 12:37:51 UTC |
| 86e0daf | Antoine R. Dumont (@ardumont) | 17 May 2018, 11:43:45 UTC | swh.scheduler.updater.ghtorrent: Clarify docstrings | 17 May 2018, 11:43:45 UTC |
| 07397ae | Antoine R. Dumont (@ardumont) | 17 May 2018, 11:43:30 UTC | swh.scheduler.updater.ghtorrent: Explicit configuration options | 17 May 2018, 11:43:30 UTC |
| c454b41 | Antoine R. Dumont (@ardumont) | 17 May 2018, 11:37:28 UTC | swh.scheduler.updater.ghtorrent: Clean up dead code | 17 May 2018, 11:37:28 UTC |
| 52614b9 | Antoine R. Dumont (@ardumont) | 17 May 2018, 11:32:06 UTC | swh.scheduler.updater.ghtorrent: Move implem inside its own module | 17 May 2018, 11:35:08 UTC |
| e2be888 | Antoine R. Dumont (@ardumont) | 17 May 2018, 10:37:46 UTC | swh.scheduler.updater.ghtorrent: Simplify consumer interface | 17 May 2018, 11:26:17 UTC |
| 0c1b67e | Antoine R. Dumont (@ardumont) | 17 May 2018, 10:24:48 UTC | swh.scheduler.updater.ghtorrent: Improve reading events | 17 May 2018, 10:29:50 UTC |
| 441aa92 | Antoine R. Dumont (@ardumont) | 16 May 2018, 16:37:56 UTC | swh.scheduler.updater.consumer: Flush memory cache | 16 May 2018, 16:39:39 UTC |
| d4dbf0a | Antoine R. Dumont (@ardumont) | 16 May 2018, 16:37:30 UTC | swh.scheduler.updater.consumer: Check for data to send in final step | 16 May 2018, 16:37:30 UTC |
| 333afe9 | Antoine R. Dumont (@ardumont) | 16 May 2018, 16:26:08 UTC | swh.scheduler.updater: Design the UpdaterConsumer interface | 16 May 2018, 16:26:08 UTC |
| f16fa5f | Antoine R. Dumont (@ardumont) | 16 May 2018, 15:38:21 UTC | swh.scheduler.updater: Don't subscribe to create event Empty repository are not that interesting, a push event on it will be much better later. | 16 May 2018, 15:38:21 UTC |
| 5bda011 | Antoine R. Dumont (@ardumont) | 16 May 2018, 13:21:24 UTC | swh.scheduler.updater: Actually use the cache_put method with list | 16 May 2018, 13:21:24 UTC |
| 3a39baa | Antoine R. Dumont (@ardumont) | 16 May 2018, 12:19:50 UTC | updater/ghtorrent: Open ghtorrent consumer as cli script | 16 May 2018, 12:27:34 UTC |
| 8d5bb5b | Antoine R. Dumont (@ardumont) | 16 May 2018, 11:44:12 UTC | updater: Actually consume ghtorrent event Also make GHTorrent and FakeGHTorrent publisher converge. Related T1051 | 16 May 2018, 11:44:12 UTC |
| b9b3c04 | Antoine R. Dumont (@ardumont) | 16 May 2018, 11:43:18 UTC | tests/updater: Simplify events tests | 16 May 2018, 11:43:18 UTC |
| 0f28201 | Antoine R. Dumont (@ardumont) | 16 May 2018, 08:18:04 UTC | swh.scheduler.updater: Move updater tests to its own arborescence | 16 May 2018, 11:42:51 UTC |
| 05cc4c3 | Antoine R. Dumont (@ardumont) | 14 May 2018, 13:17:43 UTC | updater.ghtorrent: Write events to scheduler updater backend | 14 May 2018, 13:19:18 UTC |
| 1f6b4d8 | Antoine R. Dumont (@ardumont) | 14 May 2018, 13:11:16 UTC | events: Rename event key to type | 14 May 2018, 13:11:16 UTC |
| fd37df2 | Antoine R. Dumont (@ardumont) | 14 May 2018, 13:09:56 UTC | updater.scratch: Update tryout code | 14 May 2018, 13:09:56 UTC |
| 7e88ec2 | Antoine R. Dumont (@ardumont) | 14 May 2018, 09:05:33 UTC | scheduler.api.server: Instantiate scheduler backend once per import Related 18c9dad986a1f6f19d57dd97079dc22ad10b04df | 14 May 2018, 09:05:33 UTC |
| 97f03a8 | Antoine R. Dumont (@ardumont) | 14 May 2018, 07:00:30 UTC | Fix pep8 violation, remove unused import, fix typo | 14 May 2018, 07:00:30 UTC |
| 9dd3cd3 | Antoine R. Dumont (@ardumont) | 09 May 2018, 16:06:38 UTC | swh.scheduler.updater.backend: Bootstrap backend api Related T1051 | 09 May 2018, 16:06:38 UTC |
| 464d759 | Antoine R. Dumont (@ardumont) | 09 May 2018, 09:11:40 UTC | Reference tryout code work to assert we can work with ghtorrent We cannot so far Related T1051 | 09 May 2018, 09:13:17 UTC |
| ccdc134 | Antoine R. Dumont (@ardumont) | 09 May 2018, 08:31:24 UTC | swh.scheduler.updater: Add SWHEvent class and tests around it Related T1051 | 09 May 2018, 08:33:47 UTC |
| 5de5eb9 | Antoine R. Dumont (@ardumont) | 09 May 2018, 08:29:28 UTC | scheduler.updater: Add publish/subscribe fake ghtorrent class As there remain issue with ghtorrent's infra [1], i'm using fake random generator event for now. [1] https://github.com/ghtorrent/ghtorrent.org/issues/397#issuecomment-387052462 Related T1051 | 09 May 2018, 08:33:47 UTC |
| 65e4b21 | Antoine R. Dumont (@ardumont) | 02 May 2018, 15:26:34 UTC | swh.scheduler.backend: Permit to create tasks with priority Related T1035 | 03 May 2018, 10:15:03 UTC |
| 5e92ae1 | Antoine R. Dumont (@ardumont) | 27 April 2018, 17:29:34 UTC | swh.scheduler: Schedule tasks with/without priority Related T1035 | 03 May 2018, 10:15:03 UTC |
| 9bf1a79 | Nicolas Dandrimont | 02 May 2018, 11:15:53 UTC | Don't override scheduler configuration by default | 02 May 2018, 11:15:53 UTC |
| bd3da9b | Antoine R. Dumont (@ardumont) | 26 April 2018, 15:34:07 UTC | New upstream version 0.0.26 | 26 April 2018, 15:34:07 UTC |
| ffd2dda | Antoine R. Dumont (@ardumont) | 26 April 2018, 15:33:52 UTC | d/rules: Fix package build | 26 April 2018, 15:33:52 UTC |
| 950a7d5 | Antoine R. Dumont (@ardumont) | 25 April 2018, 14:10:26 UTC | swh.scheduler.tests: Test remote scheduler api as well Related T1036 | 25 April 2018, 16:37:43 UTC |
| 6ef0a88 | Antoine R. Dumont (@ardumont) | 25 April 2018, 11:03:44 UTC | swh.scheduler: Add tests around removing archivable tasks Related T986 Related T1034 | 25 April 2018, 16:36:34 UTC |
| 7afd050 | Antoine R. Dumont (@ardumont) | 25 April 2018, 09:57:17 UTC | swh.scheduler: Add tests around filtering archivable tasks Related T986 Related T1034 | 25 April 2018, 16:36:34 UTC |
| 5ccfa8b | Antoine R. Dumont (@ardumont) | 25 April 2018, 09:02:02 UTC | swh-scheduler-schema: Fix unneeded drop instructions Should not have been committed in that file, only in the migration part. | 25 April 2018, 16:36:34 UTC |
| b7490ee | Antoine R. Dumont (@ardumont) | 24 April 2018, 14:48:05 UTC | swh.scheduler.cli: Improve docstring | 25 April 2018, 16:36:34 UTC |
| 8c3910a | Antoine R. Dumont (@ardumont) | 24 April 2018, 14:26:13 UTC | swh.scheduler.cli: Permit to specify the backend to use in cli Related T1034 | 25 April 2018, 16:36:34 UTC |
