https://forge.softwareheritage.org/source/swh-scheduler.git

sort by:
Revision Author Date Message Commit Date
5185ff4 Updated debian changelog for version 0.0.62 18 October 2019, 11:46:26 UTC
b8be489 Update upstream source from tag 'debian/upstream/0.0.62' Update to upstream version '0.0.62' with Debian dir c16c5c73fe26f74a2326573d98d759a1c191f90b 18 October 2019, 11:46:25 UTC
9485932 New upstream version 0.0.62 18 October 2019, 11:46:25 UTC
787c7a9 celery_backend.config: Make JournalHandler import optional swh-core no longer comes with JournalHandler by default. 18 October 2019, 11:33:25 UTC
c2a020d tests: rewrite tests using pytest and the new rpc fixtures from swh.core 16 October 2019, 11:20:42 UTC
a7e15bf add a new get_priority_ratios endpoint to the scheduler this is necessary to make it much easier to write tests so they do not need to execute SQL statements, which makes possible to run exactly the same tests with the SchedulerBackend as the RemoteScheduler one (see the following revision). 16 October 2019, 11:20:42 UTC
c2ccf46 updater/tests: rewrite updater's tests as pytest functions The way the scheduler_db and updater_db fixtures are built is not very straighforward nor satisfying, but it works. 16 October 2019, 11:20:42 UTC
37b909e conftest: simplify the swh_scheduler() fixture simply use the postgresql.dsn as connection string. 16 October 2019, 08:42:04 UTC
e770eb3 tests: Explicit registering test tasks step for the swh_app Prior to this commit, the celery "app" import changed. Making the runtime application load prior to the tests "swh_app". In effect, making the tasks not being consumed by workers. This explicitely forces the tests tasks registering to "swh_app". In effect clarifying code and fixing the current tests. Related D2082 Related 8eafc70 10 October 2019, 13:26:54 UTC
349d23e scheduler: Use directly the package's server module to start server Related D2109 Related D2110 10 October 2019, 10:05:38 UTC
8eafc70 tox.ini: Use tests installed files instead of working directory Related D2082 10 October 2019, 09:51:27 UTC
bd3b53d Updated debian changelog for version 0.0.61 07 October 2019, 14:37:37 UTC
ecefa55 Update upstream source from tag 'debian/upstream/0.0.61' Update to upstream version '0.0.61' with Debian dir b27725dd029d671bceb2495ca4559e488038392f 07 October 2019, 14:37:37 UTC
7f9b26f New upstream version 0.0.61 07 October 2019, 14:37:36 UTC
5955c8d celery_backend/config: Fix wrong statement Dict's get method does not take keyword argument. Related D2033#47672 02 October 2019, 04:56:13 UTC
6dad1f6 Force postgresql executable to a pg_ctl that exists when running tests. 01 October 2019, 16:26:39 UTC
873d3c5 Updated debian changelog for version 0.0.60 01 October 2019, 11:22:44 UTC
a0fb3fa Updated version 0.0.60 from 'debian/upstream/0.0.60' with Debian dir 87a64a11ce0817864c7788160e7dcb0664aa318b 01 October 2019, 11:22:43 UTC
2984a95 New upstream version 0.0.60 01 October 2019, 11:22:42 UTC
06137f0 tox: anticipate mypy run to just after flake8 01 October 2019, 11:08:23 UTC
c78b846 init.py: switch to documented way of extending path make mypy 0.730 pass cleanly again 27 September 2019, 08:38:31 UTC
1a691b5 tox.ini: add mypy section 24 September 2019, 11:55:04 UTC
c4fa353 typing: minimal changes to make a no-op mypy run pass 24 September 2019, 11:44:50 UTC
3cd5697 fix typo in docstring and sample file name courtesy of codespell 24 September 2019, 11:42:23 UTC
0a4fd7a admin CLI: drop obsolete backward compatibility aliases These have been around for a while and are no longer advertised in the --help output. 17 September 2019, 15:51:03 UTC
6a054b9 click "required" param wants bool, not int courtesy of mypy 16 September 2019, 15:13:55 UTC
87f4143 d/control: Fix indentation 09 September 2019, 09:47:03 UTC
123feaf Updated debian changelog for version 0.0.59 04 September 2019, 14:11:48 UTC
c630f46 Updated version 0.0.59 from 'debian/upstream/0.0.59' with Debian dir c485ede5bfc1fe508a791145859dc7b9384eb6b6 04 September 2019, 14:11:47 UTC
fcf8e5f New upstream version 0.0.59 04 September 2019, 14:11:47 UTC
a64ac3f sql: stop inserting lister tasks at scheduler's creation time This is now the job of the swh-lister to ensure task-type entries are created in the scheduler (in swh-lister >= 0.0.34). 04 September 2019, 13:53:19 UTC
302fb2c Updated debian changelog for version 0.0.58 03 September 2019, 08:28:19 UTC
bf51443 New upstream version 0.0.58 03 September 2019, 08:28:18 UTC
d05bfb8 Updated version 0.0.58 from 'debian/upstream/0.0.58' with Debian dir 3f3858ea2346ed52b3bf3ee2e7e9a098447647b2 03 September 2019, 08:28:18 UTC
9c2b329 50-swh-data: Add load-tar task-type This is needed to be in sync with the docker-dev environment. 03 September 2019, 08:18:30 UTC
c3fae15 celery: auto add tasks declared in the swh.workers entry point in task_modules allows to declare worker tasks in a 'swh.workers' entry point. This later is expected to be a callable which returns a dict which 'task_modules' key is a list of python module names where celery tasks are defined. 02 September 2019, 11:33:28 UTC
65c0ca5 debian/control: Bump required swh.core version 24 July 2019, 09:15:05 UTC
e1b216d api/client: use RPCClient instead of deprecated SWHRemoteAPI 23 July 2019, 12:38:29 UTC
a43b3c7 Make schedule_origins use origin urls instead of ids in task arguments. 19 July 2019, 14:35:25 UTC
cc1b590 add code of conduct document 11 July 2019, 14:29:50 UTC
f63274a docs: very beginning of a practical documentation on the scheduler 10 July 2019, 14:01:37 UTC
9b7407f updater: small refactoring to please codespell 10 July 2019, 13:58:47 UTC
92b81f3 Add a pre-commit config file 10 July 2019, 13:52:26 UTC
2044c07 data: Insert new cgit instance lister task Related T1835 28 June 2019, 15:52:57 UTC
09d9c84 CONTRIBUTORS: add Ishan Bhanuka 28 June 2019, 07:42:00 UTC
4ce0aa2 Updated debian changelog for version 0.0.57 26 June 2019, 13:05:20 UTC
f3e7605 Updated version 0.0.57 from 'debian/upstream/0.0.57' with Debian dir ad78cb2782546893ee13974d3f54852fa19d19e7 26 June 2019, 13:05:19 UTC
0ee2895 New upstream version 0.0.57 26 June 2019, 13:05:18 UTC
09e7245 Added comments to few columns in dbversion, task and task_run Change double quoted comments to single quoted comments To keep consistent comment format and to prevent syntax exception on jenkins build Make changes as per review Made changes as per review 19 June 2019, 16:13:09 UTC
237e8c5 cli: rename a admin cli commands use more imperative-like command names. Aliases are used to keep old commands working. Also add an explicit deprecation message in swh-scheduler's help message. 13 June 2019, 07:29:09 UTC
da77f89 50-swh-data: Update new lister task types Related T1797 12 June 2019, 13:22:32 UTC
46223d8 scheduler.cli.task: Fix wrong import 24 May 2019, 10:21:43 UTC
aa70df4 Drop backward compatible names The migration is now done. No longer needs this adaptation code. Related T1508 24 May 2019, 08:11:37 UTC
63eeabf data: Add missing swh-vault-batch-cooking/cook-vault-bundle-type Related T1508 23 May 2019, 11:27:41 UTC
766dae9 50-swh-data: Fix inverted select/insert in backward sql function Prior to this, the select wanted to retrieve the new name to insert the old one Ending up doing a noop. Related T1508 23 May 2019, 11:23:28 UTC
d6fce0d swh-scheduler: Use new task names Related T1508 21 May 2019, 11:34:25 UTC
d6dc50f tests: update to swh.core 0.0.61 in which (db|api)_testing.py files moved. 17 May 2019, 15:09:41 UTC
52f8c06 Update import of swh.core.api.tests.server_testing. 17 May 2019, 11:32:20 UTC
45aa02c cli: Fix swh-scheduler command (missing log_level in context) 15 May 2019, 11:57:22 UTC
ac0e474 Updated debian changelog for version 0.0.56 14 May 2019, 12:40:09 UTC
c20005a New upstream version 0.0.56 14 May 2019, 12:40:08 UTC
c9a1486 Updated version 0.0.56 from 'debian/upstream/0.0.56' with Debian dir 5f377acb9540c62bcfacc77ac80ed6ab2d19b9e1 14 May 2019, 12:40:08 UTC
ac1b8db listener: Release the db object after using it This is the contract that get_db/put_db is supposed to conform to. 10 May 2019, 13:52:36 UTC
edaf202 cli: split the main cli/__init__.py file in 4 parts extract: - the 'task' group (and its related commands) in cli/task.py - the 'task_type' group in cli/task_type.py - remaining commands in cli/admin.py 07 May 2019, 08:52:06 UTC
3f88069 README: remove the deprecated tests section 06 May 2019, 13:52:01 UTC
84c0bd7 cli: make swh-scheduler a subcommand of swh.core's main "swh" command the old "swh-scheduler" still exists for now, and is mostly backward compatible but the --log-level option (which is defined in the "swh" main command group). Unit tests have been adapted and should pass ok. 06 May 2019, 13:48:31 UTC
eb42639 cli: make it a subpackage 06 May 2019, 13:47:40 UTC
b9c1644 Updated debian changelog for version 0.0.55 06 May 2019, 09:54:51 UTC
0f9777f Updated version 0.0.55 from 'debian/upstream/0.0.55' with Debian dir dfa6720c29670600c839fc3b8167db160066fbb1 06 May 2019, 09:54:50 UTC
fd6c7c1 New upstream version 0.0.55 06 May 2019, 09:54:50 UTC
d338c76 sql/swh-data: Update scheduler task names but keep backward compatibility Related T1508 03 May 2019, 08:50:30 UTC
72eaa42 Update coverage gitignore 12 April 2019, 10:03:09 UTC
bc21a1b Updated debian changelog for version 0.0.54 11 April 2019, 09:40:15 UTC
6c37d39 Updated version 0.0.54 from 'debian/upstream/0.0.54' with Debian dir 562626c186cf2541080259044c5b51b48488248f 11 April 2019, 09:40:14 UTC
7bb55c9 New upstream version 0.0.54 11 April 2019, 09:40:13 UTC
24e6a0a cli_utils: Use yaml.safe_load instead of yaml.load 10 April 2019, 18:36:47 UTC
b644006 Fix support of latest versions of swh-core and psycopg2. 10 April 2019, 16:55:20 UTC
4b0e952 sql/data: Add npm related task types Related T1629 Related T1508 10 April 2019, 16:25:53 UTC
7240ec8 Updated debian changelog for version 0.0.53 04 April 2019, 14:55:20 UTC
138a1b3 Updated version 0.0.53 from 'debian/upstream/0.0.53' with Debian dir fde16dd9595b9252c2790a91d0276268d04bccc1 04 April 2019, 14:55:19 UTC
356b780 New upstream version 0.0.53 04 April 2019, 14:55:19 UTC
aaa9ee4 SchedulerBackend.create_tasks: Remove duplicated task key This issue was spotted after the upgrade of psycopg2 to version 2.8 04 April 2019, 14:45:14 UTC
5c5c893 Updated debian changelog for version 0.0.52 03 April 2019, 08:59:01 UTC
030fe02 New upstream version 0.0.52 03 April 2019, 08:59:00 UTC
a1fa61f Updated version 0.0.52 from 'debian/upstream/0.0.52' with Debian dir 5fe51866acd80645e9177966ceaf584be38ec1db 03 April 2019, 08:59:00 UTC
38cafb9 Make result_serializer json We kind-of-need that to test that we'll be able to understand results in production (even though we're sending results by hand, not through this event) and it works around https://github.com/celery/celery/issues/5366 in Celery 4.3. 02 April 2019, 16:05:33 UTC
b9903d7 sql/Makefile: Fix scheduler db creation 01 April 2019, 14:22:18 UTC
74b79a5 Updated debian changelog for version 0.0.51 22 March 2019, 11:16:07 UTC
1b867a8 Updated version 0.0.51 from 'debian/upstream/0.0.51' with Debian dir 3adff8fa80d2d64cc5554de32d093edb8888d388 22 March 2019, 11:16:06 UTC
6e69026 New upstream version 0.0.51 22 March 2019, 11:16:06 UTC
c2b1793 requirements.txt: Remove kombu dependency This actually conflicts with the latest celery version. We should not depend on it as this is drawn by celery already. 21 March 2019, 10:46:17 UTC
4ee93d3 API: use default's APIError exception instead of the SchedulerAPIError this later does not brings anything over the default's one. This requires swh.core >= 0.0.56 18 March 2019, 16:02:14 UTC
455ce86 Update build- and runtime dependencies 15 March 2019, 17:24:59 UTC
753e3da Updated debian changelog for version 0.0.50 15 March 2019, 17:16:04 UTC
ba40c3e Updated version 0.0.50 from 'debian/upstream/0.0.50' with Debian dir e821555864dcd41121b3efa31d516cfcb045ea1f 15 March 2019, 17:16:03 UTC
a49761d New upstream version 0.0.50 15 March 2019, 17:16:02 UTC
693a147 Remove info-level logs about already acknowledged messages Celery voluntarily pools messages to reduce traffic, so it's expected that some messages end up here several times. No need to spam logs about it. 15 March 2019, 13:25:15 UTC
763dbda Ignore INFO messages when testing CLI output. 14 March 2019, 15:36:08 UTC
1122ee1 Add a 'task schedule_origins' command to run a task on all origins. 14 March 2019, 15:36:08 UTC
3c9497d Export LC_ALL=C.UTF-8 14 March 2019, 12:42:55 UTC
back to top