| 4335cfc | Nicolas Dandrimont | 18 December 2018, 16:04:24 UTC | Automatically subscribe workers to the per-task queues That only works for actual workers (the celeryd_after_setup signal isn't sent by the test fixture), so keep the workaround in the fixture | 18 December 2018, 16:16:25 UTC |
| bbe9e55 | Nicolas Dandrimont | 18 December 2018, 15:40:03 UTC | Fix typo in celery_testing | 18 December 2018, 16:16:25 UTC |
| 4cacd65 | Nicolas Dandrimont | 18 December 2018, 14:38:39 UTC | Route tasks using their task name rather than a task_queue attribute | 18 December 2018, 16:16:25 UTC |
| f984974 | Nicolas Dandrimont | 18 December 2018, 14:32:48 UTC | celery_backend: more robust queue length management - Ignore the absence of the rabbitmq management interface - Handle inexistent queues as if they were empty | 18 December 2018, 16:16:25 UTC |
| af53734 | Nicolas Dandrimont | 18 December 2018, 14:30:01 UTC | Don't run SQL query with an empty tuple Noticed the issue when repeatedly running tests without really letting the database tear down properly... | 18 December 2018, 16:16:25 UTC |
| 15262bb | Nicolas Dandrimont | 18 December 2018, 14:28:59 UTC | Switch celery settings to lowercase names | 18 December 2018, 16:16:25 UTC |
| 7daad6f | Nicolas Dandrimont | 18 December 2018, 14:25:41 UTC | Record requirement on celery 4 The tests scaffolding depends on fixtures introduced in Celery 4 | 18 December 2018, 16:15:56 UTC |
| 9966e55 | David Douard | 18 December 2018, 09:36:47 UTC | Remove pickle from Celery's accepted content type | 18 December 2018, 09:36:47 UTC |
| 041f103 | David Douard | 18 December 2018, 09:33:56 UTC | Fix Task's docstring | 18 December 2018, 09:33:56 UTC |
| 97396ed | Antoine R. Dumont (@ardumont) | 14 December 2018, 14:50:12 UTC | Update requirements to latest swh.core Related T1444 | 14 December 2018, 14:50:12 UTC |
| 46b2ba6 | Valentin Lorentz | 03 December 2018, 13:44:54 UTC | Fallback for get_queue_stats() when using memory:// broker. Summary: When running tests, RabbitMQ is not used, so get_queue_stats() does not work. We did not notice this issue before because pytest skipped importing modules that define tasks with a queue, so this function was never actually called while running tests. Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: ardumont, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D763 | 03 December 2018, 14:53:48 UTC |
| 0f77286 | Valentin Lorentz | 03 December 2018, 13:44:54 UTC | Fallback for get_queue_stats() when using memory:// broker. When running tests, RabbitMQ is not used, so get_queue_stats() does not work. We did not notice this issue before because pytest skipped importing modules that define tasks with a queue, so this function was never actually called while running tests. | 03 December 2018, 13:44:54 UTC |
| 042edee | David Douard | 28 November 2018, 10:54:37 UTC | README: fix a typo | 28 November 2018, 10:54:37 UTC |
| cea1aed | David Douard | 22 November 2018, 11:00:15 UTC | doc: update index to match new swh-doc format related to T1330 | 23 November 2018, 12:52:54 UTC |
| 5e67d28 | Antoine R. Dumont (@ardumont) | 21 November 2018, 15:35:21 UTC | data/sql: Insert new task type for origin metadata indexer Related T1376 | 21 November 2018, 15:35:21 UTC |
| b7b596f | Antoine R. Dumont (@ardumont) | 21 November 2018, 15:33:23 UTC | data/sql: Insert new task type for revision metadata indexer Related T1375 | 21 November 2018, 15:33:23 UTC |
| 5c636ef | Antoine R. Dumont (@ardumont) | 21 November 2018, 12:00:13 UTC | data/sql: Insert new task type for origin indexer Related T1326 | 21 November 2018, 12:00:13 UTC |
| 26efaad | Antoine R. Dumont (@ardumont) | 20 November 2018, 11:23:35 UTC | sql/data: Create new range indexer fossology license task type | 20 November 2018, 11:23:35 UTC |
| 85526e1 | Antoine R. Dumont (@ardumont) | 19 November 2018, 13:31:46 UTC | sql/data: Remove orchestrator Related T1311 | 19 November 2018, 13:31:46 UTC |
| fc38be1 | Antoine R. Dumont (@ardumont) | 19 November 2018, 13:07:25 UTC | sql/data: Create new range indexer mimetype task type Related T911 | 19 November 2018, 13:08:29 UTC |
| e2c8e9b | David Douard | 09 November 2018, 11:04:33 UTC | Fix rst syntax in docstrings | 09 November 2018, 11:06:14 UTC |
| 3bdb28f | Antoine Lambert | 08 November 2018, 13:51:51 UTC | sql/updater/Makefile: Fix pifpaf test as it was always considered used | 08 November 2018, 13:51:51 UTC |
| 816f0b9 | Antoine Lambert | 08 November 2018, 13:46:07 UTC | sql/Makefile: Fix pifpaf test as it was always considered used | 08 November 2018, 13:46:07 UTC |
| 762b528 | Valentin Lorentz | 29 October 2018, 08:45:23 UTC | Add SchedulerTestFixture. Summary: Will be used by the indexers. Test Plan: There's a test included Reviewers: #reviewers, douardda, ardumont Reviewed By: #reviewers, douardda, ardumont Subscribers: ardumont, douardda, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D605 | 29 October 2018, 08:54:13 UTC |
| 4b05032 | Antoine R. Dumont (@ardumont) | 26 October 2018, 19:31:21 UTC | sql/40-swh-data: Update new indexer task types for local db Those new types need to be deployed in production when the new indexer will hit production. Related T1290 | 29 October 2018, 08:40:41 UTC |
| e51e9ff | Antoine R. Dumont (@ardumont) | 29 October 2018, 08:33:06 UTC | swh.scheduler.utils: Improve implementation to clarify intent | 29 October 2018, 08:33:06 UTC |
| eefe310 | Antoine R. Dumont (@ardumont) | 26 October 2018, 18:32:32 UTC | swh.scheduler.utils: Allow to add more task information Also add test on that function. | 26 October 2018, 18:32:32 UTC |
| f326cef | Antoine R. Dumont (@ardumont) | 25 October 2018, 15:47:40 UTC | d/rules: Update build with pytest flags Related T1261 | 25 October 2018, 15:48:09 UTC |
| e25fdf7 | Antoine R. Dumont (@ardumont) | 25 October 2018, 14:26:28 UTC | d/control: Update pytest build dependency Related T1261 | 25 October 2018, 15:47:56 UTC |
| 923e0b5 | David Douard | 25 October 2018, 13:10:23 UTC | celery: configure result_serializer to msgpack | 25 October 2018, 13:10:23 UTC |
| 1203083 | Nicolas Dandrimont | 23 October 2018, 14:48:15 UTC | Don't run pytest in the docs directory | 23 October 2018, 14:48:15 UTC |
| 73a4e43 | David Douard | 23 October 2018, 08:18:18 UTC | tests: add a too_slow setting on UpdaterConsumerWithEventTest.test_running so that hypothesis does not complains when executed on a slower (aka CI) nachine. | 23 October 2018, 08:18:18 UTC |
| 3d23931 | David Douard | 18 October 2018, 14:55:07 UTC | tests: kill deprecation warnings - assertEquals -> assertEqual - warn -> warning | 23 October 2018, 07:57:17 UTC |
| 80041ad | David Douard | 18 October 2018, 14:42:10 UTC | tests: replace nose's attr() by pytest's mark() for tests tagging related to T1261 | 23 October 2018, 07:57:17 UTC |
| 3e64657 | David Douard | 18 October 2018, 14:41:10 UTC | replace nose by pytest in test requirements and add a simple tox file related to T1261 | 23 October 2018, 07:57:09 UTC |
| 8df816a | David Douard | 17 October 2018, 07:47:10 UTC | tests: properly implement Celery broker and result configuration for tests purpose ie. use memory:// based urls. Note that these configs can be overloaded via CELERY_BROKER_URL and CELERY_RESULT_BACKEND env vars. | 18 October 2018, 07:29:58 UTC |
| 3c9fcd8 | David Douard | 17 October 2018, 14:07:49 UTC | packaging: bump dep to swh-core v0.0.44 | 17 October 2018, 14:07:49 UTC |
| f15eeb4 | David Douard | 16 October 2018, 13:24:53 UTC | tests: make tests use sql files from the package instead of dump files in test/data, and get rid of them. Related to T1265. | 16 October 2018, 13:27:29 UTC |
| ff4df2c | David Douard | 16 October 2018, 12:27:45 UTC | sql: move sql files in the python package also delete unused file swh-scheduler-testdata.sql and fix sql/Makefile and sql/updater/sql/Makefile to make them properly generate svg/pdf images and make. Related to T1265. | 16 October 2018, 13:23:34 UTC |
| 3976f99 | Antoine Lambert | 15 October 2018, 09:34:20 UTC | sql/swh-scheduler-data: Fix some task names and add svn update task | 15 October 2018, 11:28:43 UTC |
| 1e371db | Nicolas Dandrimont | 15 October 2018, 08:27:28 UTC | Rename test methods to test_* to allow collection by pytest Summary: Part of T1261 Test Plan: 37 tests on both sides of the jump Reviewers: ardumont Differential Revision: https://forge.softwareheritage.org/D530 | 15 October 2018, 08:36:58 UTC |
| 2f0f543 | Nicolas Dandrimont | 15 October 2018, 08:25:36 UTC | Use raw strings for regexps that need to escape parentheses | 15 October 2018, 08:26:20 UTC |
| a205968 | David Douard | 11 October 2018, 14:53:13 UTC | README: document how to get test data | 12 October 2018, 11:12:51 UTC |
| 8ed3f86 | David Douard | 11 October 2018, 14:10:59 UTC | tests: add celery to test requirements | 12 October 2018, 11:12:51 UTC |
| 15e895e | David Douard | 11 October 2018, 14:02:28 UTC | tests: add a CeleryTestFixture that allows to specify a celery broker URL this especially aims at allowing to run tests that do actually use non mocked celery broker using pifpaf. | 12 October 2018, 11:12:51 UTC |
| 50966d5 | David Douard | 12 October 2018, 11:07:20 UTC | tests: move the test db dump back here and ensure it is included in the source package. Related to T1265. Also add README.md to the MANIFEST.in file so it does not require a too recent setuptool. | 12 October 2018, 11:07:20 UTC |
| d5473d6 | Antoine R. Dumont (@ardumont) | 10 October 2018, 13:44:11 UTC | listener: Deal with messages received as list Prior to celery 4, the body message were sent 1 by 1. Now (celery 4), there are sent as list. This takes care of the change but can deal with prior version as well (think debian stable). Related D312#inline-2518 | 11 October 2018, 12:54:41 UTC |
| 339028c | Antoine R. Dumont (@ardumont) | 10 October 2018, 13:32:16 UTC | listener: Drop unused queue_arguments settings Related D312#inline-2519 | 11 October 2018, 12:54:41 UTC |
| cce9505 | Antoine R. Dumont (@ardumont) | 09 October 2018, 12:56:07 UTC | celery_backend.listener: Use debugging logging statements | 11 October 2018, 12:54:41 UTC |
| 52d041e | Antoine R. Dumont (@ardumont) | 09 October 2018, 12:51:26 UTC | celery_backend.listener: Access directly existing queue_arguments | 11 October 2018, 12:54:40 UTC |
| bb29ff3 | Antoine R. Dumont (@ardumont) | 27 April 2018, 13:33:08 UTC | Fix scheduler listener on buster's celery version (4.1.0-4) | 11 October 2018, 12:54:40 UTC |
| 4e52e40 | Nicolas Dandrimont | 20 September 2018, 13:25:51 UTC | Make swh_scheduler_create_tasks_from_temp use indexes We don't have an index on task.arguments, but we have one on each of its args and kwargs elements. We therefore make sure we use these indexes. | 10 October 2018, 15:10:55 UTC |
| 5f256e5 | David Douard | 04 October 2018, 14:46:47 UTC | add build/ and dist/ to gitignore | 08 October 2018, 10:18:46 UTC |
| 226c398 | David Douard | 04 October 2018, 14:45:17 UTC | setup: prepare for pypi upload related to T1242 | 08 October 2018, 10:18:46 UTC |
| 99d5e7f | David Douard | 04 October 2018, 14:44:51 UTC | docs: add a simple README file | 08 October 2018, 10:16:47 UTC |
| d070070 | Antoine Pietri | 05 October 2018, 10:55:39 UTC | Add requirements-test.txt | 05 October 2018, 10:55:56 UTC |
| 0f4da9a | Valentin Lorentz | 02 October 2018, 14:57:51 UTC | Add test requirement. | 02 October 2018, 14:58:17 UTC |
| 239bdec | Stefano Zacchiroli | 01 October 2018, 14:01:14 UTC | docs: add title and brief module description | 01 October 2018, 14:01:14 UTC |
| da09ad0 | Antoine R. Dumont (@ardumont) | 28 September 2018, 10:22:47 UTC | sql/data: Update svn task name according to latest development | 28 September 2018, 10:28:43 UTC |
| 5f616b8 | Antoine R. Dumont (@ardumont) | 19 September 2018, 17:56:33 UTC | sql/data: Use the same max queue length as production | 19 September 2018, 17:56:33 UTC |
| 53c8225 | Stefano Zacchiroli | 19 September 2018, 15:19:21 UTC | use /usr/bin/env python3 as shebang, to be nice to virtualenv | 19 September 2018, 15:19:21 UTC |
| 4f51996 | Stefano Zacchiroli | 15 September 2018, 12:19:30 UTC | requirements.txt: add spaces around dep expression as we do everywhere else purely cosmetic change | 15 September 2018, 12:21:08 UTC |
| 218726d | Antoine R. Dumont (@ardumont) | 14 September 2018, 12:53:05 UTC | sql/scheduler-data: Normalize PyPI name for loader task | 14 September 2018, 12:53:05 UTC |
| 62331cf | Antoine R. Dumont (@ardumont) | 14 September 2018, 11:31:04 UTC | sql/scheduler-data: Normalize PyPI name Related T422 | 14 September 2018, 11:31:04 UTC |
| f088066 | Antoine R. Dumont (@ardumont) | 13 September 2018, 23:17:21 UTC | swh-scheduler-data: Update loader pypi backend_name task | 13 September 2018, 23:37:54 UTC |
| c4696cd | Antoine R. Dumont (@ardumont) | 03 August 2018, 08:37:26 UTC | sql/swh-scheduler-data: Reference the origin-update-pypi task type | 03 August 2018, 08:37:26 UTC |
| 458d604 | Antoine R. Dumont (@ardumont) | 01 August 2018, 08:56:30 UTC | sql/swh-scheduler-data: Reference pypi lister task | 01 August 2018, 08:56:30 UTC |
| 2a1b5d5 | Antoine R. Dumont (@ardumont) | 01 August 2018, 08:55:43 UTC | sql/swh-scheduler-data: Fix missing space tabulation | 01 August 2018, 08:55:43 UTC |
| 1c2899c | Antoine R. Dumont (@ardumont) | 30 July 2018, 16:14:11 UTC | sql/swh-scheduler: Make the create_tasks call idempotent + tests ok The tests were ko due to a missing step of mine (rebuilding the schema). Fortunately, this was not yet deployed. | 30 July 2018, 16:23:46 UTC |
| e4dd0a1 | Antoine R. Dumont (@ardumont) | 27 July 2018, 15:08:16 UTC | sql/swh-scheduler: Make the create_tasks call idempotent This in effect returns all rows associated with the tasks asked for creation (the input). If tasks were already created, we only return them. If they were not created, we create and return them. | 27 July 2018, 15:26:06 UTC |
| 9140960 | Antoine R. Dumont (@ardumont) | 27 July 2018, 11:48:28 UTC | swh.scheduler.utils: Open create_task_dict function | 27 July 2018, 11:48:28 UTC |
| 6e33cc7 | Antoine R. Dumont (@ardumont) | 19 July 2018, 09:21:21 UTC | sql/scheduler-data: Fix gitlab task type typos Related T1151 | 19 July 2018, 09:21:21 UTC |
| b0e03a7 | Antoine R. Dumont (@ardumont) | 18 July 2018, 16:26:49 UTC | sql/scheduler-data: Add lister gitlab task types Related T1151 | 18 July 2018, 16:28:47 UTC |
| a8271e9 | Antoine R. Dumont (@ardumont) | 18 July 2018, 16:20:27 UTC | sql/scheduler-data: Reference the existing production lister data | 18 July 2018, 16:20:27 UTC |
| fd1db01 | Antoine R. Dumont (@ardumont) | 28 June 2018, 08:44:05 UTC | swh.scheduler.backend_es: Open sniffing options | 28 June 2018, 08:45:35 UTC |
| fc8c8d6 | Antoine R. Dumont (@ardumont) | 22 June 2018, 12:12:55 UTC | swh-scheduler-schema.sql: Archive disabled oneshot tasks as well | 22 June 2018, 16:06:04 UTC |
| 3795fde | Antoine R. Dumont (@ardumont) | 31 May 2018, 13:12:18 UTC | swh.scheduler.cli: Add policy to pretty printing task routine | 31 May 2018, 13:12:18 UTC |
| db0d47a | Antoine R. Dumont (@ardumont) | 31 May 2018, 13:07:28 UTC | swh.scheduler.cli: Fix broken cli list-pending since api change | 31 May 2018, 13:07:44 UTC |
| 8bbbe7b | Antoine R. Dumont (@ardumont) | 31 May 2018, 09:37:04 UTC | swh.scheduler.cli: Change archival period to rolling month - 1 week This will permit a time window of 1 week to check everything is going smoothly in the scheduler db. Related T1031 Close T986 | 31 May 2018, 09:42:21 UTC |
| 05c64c0 | Antoine R. Dumont (@ardumont) | 30 May 2018, 18:28:43 UTC | swh.scheduler.updater.writer: Force filter resolution to list | 30 May 2018, 18:29:05 UTC |
| c4dd3c8 | Antoine R. Dumont (@ardumont) | 30 May 2018, 18:28:17 UTC | swh.scheduler.cli: Change default archival period to current month | 30 May 2018, 18:28:17 UTC |
| d0f7e94 | Antoine R. Dumont (@ardumont) | 30 May 2018, 14:18:11 UTC | swh.scheduler.cli: Improve logging message | 30 May 2018, 14:18:11 UTC |
| 7e03d80 | Antoine R. Dumont (@ardumont) | 30 May 2018, 14:17:44 UTC | swh.scheduler.updater.backend: Adapt configuration path accordingly | 30 May 2018, 14:17:44 UTC |
| 9f41ce3 | Antoine R. Dumont (@ardumont) | 29 May 2018, 12:11:07 UTC | packaging: Remove hypothesis as a runtime dependencies | 29 May 2018, 12:11:07 UTC |
| cde2def | Antoine R. Dumont (@ardumont) | 29 May 2018, 10:08:41 UTC | packaging: Remove .hypothesis folder | 29 May 2018, 10:26:22 UTC |
| 7b45010 | Antoine R. Dumont (@ardumont) | 29 May 2018, 10:00:04 UTC | packaging: Fix tests in packaging | 29 May 2018, 10:26:22 UTC |
| a864649 | Antoine R. Dumont (@ardumont) | 29 May 2018, 09:36:32 UTC | packaging: Fix python3-swh.scheduler.updater tests package | 29 May 2018, 10:26:22 UTC |
| 1bdfaf1 | Antoine R. Dumont (@ardumont) | 29 May 2018, 09:22:40 UTC | d/control: Add new python3-swh.scheduler.updater package | 29 May 2018, 10:26:22 UTC |
| 5e56731 | Antoine R. Dumont (@ardumont) | 29 May 2018, 09:22:22 UTC | d/control: Fix runtime dependency version | 29 May 2018, 09:22:22 UTC |
| 58352e2 | Antoine R. Dumont (@ardumont) | 28 May 2018, 14:46:43 UTC | swh.scheduler.updater.writer: Add tests around writer | 28 May 2018, 14:57:35 UTC |
| 09e028e | Antoine R. Dumont (@ardumont) | 28 May 2018, 14:45:37 UTC | swh.scheduler.updater.backend: Make the reading timestamp optional | 28 May 2018, 14:46:07 UTC |
| 9def570 | Antoine R. Dumont (@ardumont) | 28 May 2018, 14:45:10 UTC | swh.scheduler.updater.writer: Do not set the limit at this level | 28 May 2018, 14:45:10 UTC |
| c288da2 | Antoine R. Dumont (@ardumont) | 28 May 2018, 09:34:05 UTC | swh.scheduler.updater.writer: Write tasks in batch Also, make the writer stops when no more data to write | 28 May 2018, 09:34:05 UTC |
| ab844be | Antoine R. Dumont (@ardumont) | 25 May 2018, 13:57:38 UTC | swh-scheduler: Fill in the blanks between priority tasks Related T1035 Related T1031 | 25 May 2018, 15:21:09 UTC |
| 378d23b | Antoine R. Dumont (@ardumont) | 25 May 2018, 08:33:38 UTC | data/elastic-template.json: Use 1 shard for the swh-tasks index | 25 May 2018, 08:33:38 UTC |
| d925b05 | Antoine R. Dumont (@ardumont) | 25 May 2018, 07:40:10 UTC | swh.scheduler.backend: Drop duplicate tasks at creation time Related T1031 Related T1051 | 25 May 2018, 07:41:27 UTC |
| 3f02cc3 | Antoine R. Dumont (@ardumont) | 24 May 2018, 09:50:46 UTC | swh.scheduler.api.client: Permit to specify the query timeout option Related T1061 | 25 May 2018, 07:41:27 UTC |
| 2b660ca | Antoine R. Dumont (@ardumont) | 23 May 2018, 13:59:38 UTC | swh.scheduler.backend: Add missing type cast | 23 May 2018, 13:59:38 UTC |
| 455f6d4 | Antoine R. Dumont (@ardumont) | 23 May 2018, 13:59:21 UTC | swh.scheduler.updater.writer: Remove noqa statement | 23 May 2018, 13:59:21 UTC |
| 56ce0f0 | Antoine R. Dumont (@ardumont) | 23 May 2018, 12:40:34 UTC | swh.scheduler.celery_backend.runner: Read more oneshot tasks | 23 May 2018, 12:40:34 UTC |
