| 4244824 | David Douard | 13 January 2020, 10:44:17 UTC | Fix an order-related eventual fail in test_deposit_private_read_archive.py | 13 January 2020, 10:44:17 UTC |
| 75e7385 | David Douard | 10 January 2020, 14:43:19 UTC | Make tests pass with django 2 For this we: - ensure we create the DepositRequest with str as raw_metadata (instead of a bytes), and - make atom_dataset return a str instead of a bytes Every time this chunk of data is sent on the wire (http req to the django app) this needs to be an str, otherwise we have things like: raw_metadata = "b'[...]'" especially when testing against django 2, which is the only django version available on debian sid, so this is needed to make it possible to build the deb file on sid *with* tests enabled. - add a py3-django2 environment in tox - bump the dependency to django <3 in requirements-server.txt (otherwise it will take precendence on the deps: field of the tox file, thus execute tests in py3-django2 with django 1.11). Note that no other tests than executing pytest have been done with django2, so do not expect it works flawlessly. | 10 January 2020, 15:59:44 UTC |
| 00eadef | David Douard | 10 January 2020, 10:41:20 UTC | Add tox.ini and pytest.ini in the MANIFEST.in file | 10 January 2020, 14:56:30 UTC |
| 030a342 | David Douard | 09 January 2020, 10:08:50 UTC | Remove dependency on swh.loader.tar This later no longer exists. | 09 January 2020, 10:11:08 UTC |
| 19a10ba | David Douard | 08 January 2020, 12:20:57 UTC | api/private/read: use application/zip as content_type for the sake of consistency. | 08 January 2020, 12:23:46 UTC |
| 90a5072 | David Douard | 08 January 2020, 12:17:19 UTC | api/private/read: use shutil.make_archive directly to generate the zip file this code was the only user for the swh.core.tarball.compress function. Doing so allows to reduce a bit the complexity and coupligin in the code. It will also allow to get rid of the swh.core.tarball.compress function. | 08 January 2020, 12:23:46 UTC |
| 5e68684 | David Douard | 07 January 2020, 09:25:21 UTC | Rename deposit/client/__init__.py as deposit/client.py No need for this to be a subpackage. | 08 January 2020, 12:23:46 UTC |
| fc097da | Valentin Lorentz | 19 December 2019, 14:13:34 UTC | Update documentation of --author to use names instead of emails. This reflects what is done in practice and what the code expects. Using an email is invalid because the value of --author is used in a `http://schema.org/name` property, not `http://schema.org/email` | 07 January 2020, 10:43:01 UTC |
| c8cf77b | David Douard | 20 December 2019, 11:06:25 UTC | cli/client: add a --format option to cli client commands This new option allows these cli commands (upload and status) to produce JSON or YAML output, so it's easier to test. | 20 December 2019, 11:17:49 UTC |
| 5a63595 | David Douard | 19 December 2019, 08:18:21 UTC | tests: make tests run with a proper scheduler so the scheduler interaction code is executed. Note that this does not test for correctness in these interactions yet. also move tests/__init__.py content in tests/conftest.py and adapt test code accordingly. This also ensures retries_left is set otherwise tests may fail when using the local sheduler. | 20 December 2019, 11:09:17 UTC |
| 6477259 | David Douard | 17 December 2019, 14:21:27 UTC | conftest: use pytest-postgresql for django related tests Replace the (non-working) django init hook by overloaded django_db_setup and make this django_db_setup use pytest-postgresql so we do not depend on external test environment (running postgresql server, tox or hand managed pifpaf). | 20 December 2019, 11:09:17 UTC |
| 3edb913 | David Douard | 16 December 2019, 12:02:28 UTC | Always generate a zip file from uploaded archives even if there is only one of those, otherwise the loader will fail since this later does expect the archive to be a zip file. | 20 December 2019, 11:09:17 UTC |
| 00cc608 | David Douard | 16 December 2019, 11:56:14 UTC | Move load-deposit task creation code in the deposit-check private API endpoint Also replace utils.origin_url_from() by a Deposit.origin_url property, and ensure the archive file format of the uploaded file is supported. The rename of invalid.tar.gz as invalid.gz is required for tests to pass which should not be the case. It will be investigated in a later revision, but for now we want tests to be green. This requires to make config dict available in SWHPrivateAPIView so we can have access to a scheduler from there. | 20 December 2019, 11:09:08 UTC |
| 5c85e6d | David Douard | 11 December 2019, 09:42:48 UTC | Make load-deposit and check-deposit URL argument absolute ensuring these generalted URLs are correct and resolvable (eg. when the WSGI app is mounted on a different path than /). This needed to move the post_deposit_save code from a signal directly within the view, so we have a request from which we can forge absolute URLs. | 20 December 2019, 11:08:17 UTC |
| e25693b | Valentin Lorentz | 18 December 2019, 17:56:16 UTC | Improve validation of --author and --name. Mostly, the code used to allow having either --author or --name, while it should use either both (when generating metadata) or neither (when using a metadata file). This code fixes this, and also catches some more invalid cases. | 19 December 2019, 14:01:02 UTC |
| 05be3e6 | Valentin Lorentz | 18 December 2019, 17:32:27 UTC | Clean temporary file handling for metadata generation, and add test. This uses a context-manager instead of manually handling removing the file. | 19 December 2019, 13:59:53 UTC |
| 78fd892 | Valentin Lorentz | 17 December 2019, 18:11:18 UTC | Start writing tests for the deposit upload CLI. | 19 December 2019, 12:41:32 UTC |
| 42ed3e1 | Valentin Lorentz | 17 December 2019, 18:09:25 UTC | Fix log level + status code of the client CLI in case of error. 'return' statements were ignored, and log level was too low for an error. | 18 December 2019, 10:23:53 UTC |
| eb2631a | Valentin Lorentz | 17 December 2019, 18:06:25 UTC | Make the atom_dataset fixture available to all tests. | 18 December 2019, 10:23:53 UTC |
| 0c1a59c | Valentin Lorentz | 11 December 2019, 14:47:43 UTC | Add sentry integration. | 18 December 2019, 10:23:53 UTC |
| 68d4b86 | Antoine R. Dumont (@ardumont) | 12 December 2019, 14:20:14 UTC | deposit.tests: Cleanup some more dead code Related to 0a9ec2a | 12 December 2019, 14:20:14 UTC |
| 49f6d75 | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:50:39 UTC | deposit.signals: Remove compatibility code The deposit service only sends message for the current new deposit loader. | 06 December 2019, 11:35:17 UTC |
| 0a9ec2a | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:50:20 UTC | deposit.loader: Remove no longer used deprecated loader | 06 December 2019, 11:35:17 UTC |
| 05ad781 | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:25:33 UTC | deposit.api: Add a basic api page to avoid broken link Related to T2140 | 06 December 2019, 11:26:59 UTC |
| 101110f | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:25:17 UTC | deposit.urls: Improve module docstring | 06 December 2019, 11:26:04 UTC |
| b44057e | Antoine R. Dumont (@ardumont) | 06 December 2019, 07:59:29 UTC | homepage: Improve sentence phrasing | 06 December 2019, 11:26:04 UTC |
| 19fefb7 | Antoine Lambert | 03 December 2019, 14:29:47 UTC | requirements: Pin mypy and django-stubs version Current djangos-stubs version (1.2.0) is not compatible with latest mypy one (0.750). So pin their version until the issue is fixed. | 03 December 2019, 14:30:04 UTC |
| a51bf9b | Antoine R. Dumont (@ardumont) | 25 November 2019, 17:27:57 UTC | deposit.signal: Simplify configuration entry | 25 November 2019, 17:27:57 UTC |
| 7e42142 | Antoine R. Dumont (@ardumont) | 25 November 2019, 13:47:05 UTC | mypy: Fix missing import | 25 November 2019, 13:47:52 UTC |
| 5e95af9 | Antoine R. Dumont (@ardumont) | 25 November 2019, 13:47:14 UTC | deposit.signals: Send versioned scheduler tasks | 25 November 2019, 13:47:52 UTC |
| 7b513a6 | Antoine R. Dumont (@ardumont) | 04 October 2019, 14:11:02 UTC | deposit.signals: Scheduler load-deposit task with new endpoints Related T2024 | 25 November 2019, 11:27:34 UTC |
| b646d12 | David Douard | 21 November 2019, 16:53:53 UTC | Fix migration scripts for 80 column lines so pre-commit is happy. | 21 November 2019, 16:53:53 UTC |
| 3aeae79 | David Douard | 21 November 2019, 13:12:44 UTC | Add a pre-commit config file | 21 November 2019, 16:53:09 UTC |
| 399b0d7 | Nicolas Dandrimont | 21 November 2019, 10:55:12 UTC | Migrate tox.ini to extras = xxx instead of deps = .[testing] | 21 November 2019, 10:55:12 UTC |
| 3c1930d | Nicolas Dandrimont | 21 November 2019, 10:54:38 UTC | Merge tox environment configuration | 21 November 2019, 10:54:38 UTC |
| cbf523d | Nicolas Dandrimont | 21 November 2019, 10:52:39 UTC | Remove pytest<4 version constraint | 21 November 2019, 10:52:58 UTC |
| b2ee4e9 | Nicolas Dandrimont | 20 November 2019, 18:56:38 UTC | Include all requirements in MANIFEST.in | 20 November 2019, 18:56:38 UTC |
| 45a982d | Stefano Zacchiroli | 07 November 2019, 12:42:49 UTC | Makefile.local: port to new swh-environment typecheck naming | 07 November 2019, 12:42:49 UTC |
| 39d1241 | Stefano Zacchiroli | 07 November 2019, 08:30:38 UTC | mypy: properly type get/put methods, as well deposit_requests_types dict | 07 November 2019, 08:30:38 UTC |
| dd06930 | Stefano Zacchiroli | 07 November 2019, 08:24:27 UTC | tox.ini: pass DJANGO_SETTINGS_MODULE to mypy environment hat tip to @anlambert for the tip | 07 November 2019, 08:24:27 UTC |
| 17b3ee4 | Stefano Zacchiroli | 01 November 2019, 14:35:49 UTC | mypy: ignore psycopg2 | 01 November 2019, 14:35:49 UTC |
| 4bb1de4 | Stefano Zacchiroli | 01 November 2019, 14:35:26 UTC | Makefile.local: sync typecheck target with global Makefile.python | 01 November 2019, 14:35:26 UTC |
| 00440eb | Stefano Zacchiroli | 01 November 2019, 10:56:51 UTC | requirements-test.txt: add back deps from master | 01 November 2019, 10:56:51 UTC |
| 34153ef | Stefano Zacchiroli | 01 October 2019, 10:28:25 UTC | tox: add mypy environment | 01 November 2019, 10:55:36 UTC |
| 422b92f | Stefano Zacchiroli | 27 September 2019, 08:33:01 UTC | init.py: switch to documented way of extending path make mypy 0.730 pass cleanly again | 01 November 2019, 10:55:36 UTC |
| 0b3d526 | Stefano Zacchiroli | 25 September 2019, 09:41:27 UTC | typing: convert leftover variable annotation to comments | 01 November 2019, 10:55:36 UTC |
| fd8db57 | Stefano Zacchiroli | 24 September 2019, 09:02:11 UTC | typing: minimal changes to make a no-op mypy run pass | 01 November 2019, 10:55:36 UTC |
| eb60bf5 | Nicolas Dandrimont | 30 October 2019, 14:08:05 UTC | Revert "deposit.signals: Scheduler load-deposit task with new endpoints" This reverts commit 12e3966b168e7be7b19aeb8c0a8d664667c81b3d. | 30 October 2019, 14:08:05 UTC |
| 9b65a13 | Antoine R. Dumont (@ardumont) | 21 October 2019, 13:14:19 UTC | swh.deposit.tests: Drop dead code | 21 October 2019, 13:23:56 UTC |
| 7f3c655 | Antoine R. Dumont (@ardumont) | 21 October 2019, 11:23:40 UTC | tests.loader: Migrate to pytest | 21 October 2019, 13:23:56 UTC |
| d5a394a | Antoine R. Dumont (@ardumont) | 21 October 2019, 10:11:06 UTC | tests.checker: Migrate to pytest | 21 October 2019, 13:23:56 UTC |
| 89a466e | Antoine R. Dumont (@ardumont) | 21 October 2019, 09:08:44 UTC | tests.loader: Migrate test_client to pytest | 21 October 2019, 13:23:56 UTC |
| 44f5906 | Antoine R. Dumont (@ardumont) | 21 October 2019, 07:22:57 UTC | tox.ini: Update tox.ini requirements | 21 October 2019, 13:23:56 UTC |
| 1ad0bf5 | Antoine R. Dumont (@ardumont) | 20 October 2019, 22:59:36 UTC | tests_deposit_private_read_metadata: Migrate to pytest | 20 October 2019, 22:59:36 UTC |
| 771ffae | Antoine R. Dumont (@ardumont) | 20 October 2019, 18:10:13 UTC | tests_deposit_private_read_archive: Migrate to pytest | 20 October 2019, 18:10:13 UTC |
| 29b30d4 | Antoine R. Dumont (@ardumont) | 20 October 2019, 17:33:55 UTC | tests_deposit_private_update_status: Migrate to pytest | 20 October 2019, 17:33:55 UTC |
| 8d49c14 | Antoine R. Dumont (@ardumont) | 20 October 2019, 15:39:30 UTC | tests_deposit_private_check: Migrate to pytest | 20 October 2019, 17:33:48 UTC |
| 2de3ee3 | Antoine R. Dumont (@ardumont) | 20 October 2019, 15:31:19 UTC | test_deposit_update: Migrate to pytest | 20 October 2019, 15:31:19 UTC |
| dd68e9a | Antoine R. Dumont (@ardumont) | 20 October 2019, 13:54:29 UTC | test_deposit: Migrate to pytest Also add more tests on the deposit parent build scenario. | 20 October 2019, 13:54:29 UTC |
| 370f00c | Antoine R. Dumont (@ardumont) | 20 October 2019, 12:08:07 UTC | test_deposit_multipart: Migrate to pytest | 20 October 2019, 12:08:07 UTC |
| 19e290f | Antoine R. Dumont (@ardumont) | 20 October 2019, 09:56:21 UTC | test_deposit_delete: Migrate to pytest | 20 October 2019, 09:56:21 UTC |
| 486f155 | Antoine R. Dumont (@ardumont) | 20 October 2019, 09:16:04 UTC | test_deposit_binary: Migrate to pytest | 20 October 2019, 09:56:11 UTC |
| 981d1fa | Antoine R. Dumont (@ardumont) | 20 October 2019, 08:23:15 UTC | test_deposit_atom: Migrate to pytest | 20 October 2019, 08:23:15 UTC |
| 6b5dbdb | Antoine R. Dumont (@ardumont) | 20 October 2019, 06:49:00 UTC | test_deposit_list: Migrate to pytest | 20 October 2019, 08:23:08 UTC |
| ddd9b4f | Antoine R. Dumont (@ardumont) | 19 October 2019, 18:00:39 UTC | test_deposit_status: Migrate to pytest | 20 October 2019, 06:18:44 UTC |
| 9adb050 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:46:07 UTC | tests: Fix pep8 violations | 19 October 2019, 17:46:07 UTC |
| d491b64 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:39:35 UTC | test.api.service_document: Migrate to pytest tests | 19 October 2019, 17:45:30 UTC |
| 9b9e9c7 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:36:09 UTC | test.loader.conftest: Add missing headers | 19 October 2019, 17:45:30 UTC |
| e252566 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:35:57 UTC | pytest.ini: Add markers to remove pytest warnings | 19 October 2019, 17:45:30 UTC |
| 680b062 | Antoine R. Dumont (@ardumont) | 19 October 2019, 15:50:49 UTC | test_parser: Migrate to pytest tests | 19 October 2019, 17:45:30 UTC |
| dc36c99 | Antoine R. Dumont (@ardumont) | 19 October 2019, 15:46:34 UTC | Start migrate tests to pytest-django That also fix the pytest tests run | 19 October 2019, 17:45:29 UTC |
| a1d7932 | Antoine R. Dumont (@ardumont) | 19 October 2019, 14:25:23 UTC | tests_utils: Migrate to pytest tests | 19 October 2019, 14:25:30 UTC |
| 6ff940c | Antoine R. Dumont (@ardumont) | 19 October 2019, 14:17:17 UTC | tests_converters: Migrate to pytest | 19 October 2019, 14:25:17 UTC |
| 2c31d21 | Antoine R. Dumont (@ardumont) | 19 October 2019, 14:16:26 UTC | Use @shared_task decorator instead of binding to specific celery app | 19 October 2019, 14:16:26 UTC |
| 5dfbeac | Antoine R. Dumont (@ardumont) | 10 October 2019, 08:25:49 UTC | Remove indirection swh.deposit.wsgi to start server Related f147893 Related D2109 | 10 October 2019, 08:25:49 UTC |
| 12e3966 | Antoine R. Dumont (@ardumont) | 04 October 2019, 14:11:02 UTC | deposit.signals: Scheduler load-deposit task with new endpoints Related T2024 | 04 October 2019, 16:01:17 UTC |
| 86bc253 | Antoine R. Dumont (@ardumont) | 04 October 2019, 14:06:31 UTC | tests: Explicit private tests in their names | 04 October 2019, 14:12:41 UTC |
| b762b98 | Antoine R. Dumont (@ardumont) | 04 October 2019, 13:55:32 UTC | deposit.private.api: Expose new endpoints with no collection name This is not used. Related T2024 | 04 October 2019, 14:12:32 UTC |
| 2499370 | Stefano Zacchiroli | 25 September 2019, 09:07:29 UTC | models: add migration to on_delete=protect | 25 September 2019, 09:07:29 UTC |
| 260de31 | Stefano Zacchiroli | 24 September 2019, 09:02:43 UTC | models: add required on_delete kwarg to ForeignKey courtesy of mypy | 24 September 2019, 09:02:43 UTC |
| 8f39669 | Stefano Zacchiroli | 19 September 2019, 13:59:44 UTC | admin CLI: avoid redefining deposit name in admin subcommand | 19 September 2019, 13:59:44 UTC |
| 11f8bbb | Stefano Zacchiroli | 16 September 2019, 15:18:04 UTC | click "required" param wants bool, not int courtesy of mypy | 17 September 2019, 06:55:48 UTC |
| cae84fc | Stefano Zacchiroli | 16 September 2019, 15:19:12 UTC | fix typos in docstrings and docs courtesy of codespell | 16 September 2019, 15:19:12 UTC |
| c40f076 | David Douard | 05 September 2019, 07:49:20 UTC | setup: register the worker task in the swh.workers entrypoint | 05 September 2019, 07:51:30 UTC |
| e2ef7bc | Valentin Lorentz | 04 September 2019, 09:50:44 UTC | Add missing visit_type attribute. Required in swh-core >= v0.0.45. | 04 September 2019, 09:55:08 UTC |
| 7d65587 | Antoine R. Dumont (@ardumont) | 30 August 2019, 13:54:03 UTC | cli/client: Simplify url definition to use Prior to this commit, we'd need to add the url with the /1 suffix. This now automatically add it. This avoids confusing errors when not provided. This also adds some unit tests to the cli. | 30 August 2019, 13:56:06 UTC |
| a88617a | Antoine R. Dumont (@ardumont) | 30 August 2019, 09:10:53 UTC | cli/admin: Add the default domain value to empty Same as provider url | 30 August 2019, 09:10:53 UTC |
| b8c0d2d | Antoine R. Dumont (@ardumont) | 30 August 2019, 09:10:39 UTC | doc/sys-info: Clarify commands | 30 August 2019, 09:10:39 UTC |
| 100e904 | Antoine R. Dumont (@ardumont) | 30 August 2019, 09:07:41 UTC | deposit_data: Remove no longer used DepositRequestType references | 30 August 2019, 09:10:15 UTC |
| 5bb3e21 | Stefano Zacchiroli | 11 July 2019, 14:30:25 UTC | add code of conduct document | 11 July 2019, 14:30:25 UTC |
| 13c8651 | Morane Otilia Gruenpeter | 11 July 2019, 14:03:07 UTC | Merge branch 'docs' | 11 July 2019, 14:03:07 UTC |
| 7582336 | Morane Otilia Gruenpeter | 19 June 2019, 15:17:43 UTC | Added release artifact in loading specification Release artifact is now specified for a deposit with a review of the loading specification Added diagram about the deposit status Fixes on test scenaris as well | 11 July 2019, 13:56:35 UTC |
| 4c43247 | Ishan Bhanuka | 28 June 2019, 03:32:47 UTC | Revert "Reformat docstrings for max line length" This reverts commit 216d0f74d8c3eeebb5d37f4d7f02130771caf7c6. | 28 June 2019, 13:02:31 UTC |
| 48b3035 | Stefano Zacchiroli | 28 June 2019, 07:42:00 UTC | CONTRIBUTORS: add Ishan Bhanuka | 28 June 2019, 07:42:00 UTC |
| 216d0f7 | Ishan Bhanuka | 27 June 2019, 04:08:00 UTC | Reformat docstrings for max line length | 27 June 2019, 04:08:00 UTC |
| 3f34909 | Morane Otilia Gruenpeter | 19 June 2019, 14:33:38 UTC | Update loading specification review place technical details in a new spec document review text and update to current state | 19 June 2019, 14:33:38 UTC |
| ce2ed8b | Morane Otilia Gruenpeter | 19 June 2019, 13:13:05 UTC | Added test scenarios with HAL | 19 June 2019, 13:13:05 UTC |
| e03e819 | Valentin Lorentz | 18 June 2019, 15:15:53 UTC | Remove argument origin_id from call to Loader.send_origin_metadata. It no longer needs that argument. | 18 June 2019, 15:15:53 UTC |
| c1e6ffa | Antoine Lambert | 16 May 2019, 14:27:50 UTC | signals: Update scheduler task names to new ones Related T1508 | 21 May 2019, 11:30:46 UTC |
| 897ddc1 | David Douard | 17 May 2019, 13:57:48 UTC | tox: workaround to pip's inability to properly solve dependency resolution Without this, some dependencies from swh.core[http] are not installed (because swh.core, without extras, is installed first from requirements-swh.txt). Probably similar to this issue https://github.com/pypa/pip/issues/6506 | 20 May 2019, 13:31:23 UTC |
