739976a | Jenkins for Software Heritage | 07 May 2020, 13:52:49 UTC | New upstream version 0.0.84 | 07 May 2020, 13:52:49 UTC |
25d7f75 | Antoine R. Dumont (@ardumont) | 07 May 2020, 13:30:12 UTC | test: Add checks scenario test cases | 07 May 2020, 13:30:12 UTC |
108fa11 | Antoine R. Dumont (@ardumont) | 07 May 2020, 13:09:04 UTC | test_tasks: Unify mocking using pytest-mock fixture | 07 May 2020, 13:09:04 UTC |
cd9c642 | Antoine R. Dumont (@ardumont) | 07 May 2020, 13:02:00 UTC | test_task: Mark it to be ignore during debian build | 07 May 2020, 13:04:17 UTC |
a84a2e1 | Jenkins for Software Heritage | 07 May 2020, 09:56:38 UTC | New upstream version 0.0.83 | 07 May 2020, 09:56:38 UTC |
d255958 | Valentin Lorentz | 05 May 2020, 13:48:01 UTC | Pass collection + id to the checker instead of an URL. This allows the checker to use a configurable URL, in case it needs an URL different from the one used by the client. For example a client outside docker would use http://localhost:5080/deposit/ to access the API, but the checker cannot use this URL (it needs either nginx or swh-deposit as hostname). | 06 May 2020, 10:46:41 UTC |
cb6bc3a | Valentin Lorentz | 04 May 2020, 11:46:46 UTC | Add a test checking a check-deposit task is created. That code was not covered so far. | 04 May 2020, 12:54:28 UTC |
e979f58 | Stefano Zacchiroli | 29 April 2020, 16:30:57 UTC | setup.py: add documentation link | 29 April 2020, 16:30:57 UTC |
20a9301 | Jenkins for Software Heritage | 23 April 2020, 14:45:47 UTC | New upstream version 0.0.82 | 23 April 2020, 14:45:47 UTC |
4752ab9 | Antoine R. Dumont (@ardumont) | 22 April 2020, 16:13:26 UTC | deposit_read: Simplify api to return only relevant deposit information This avoids: - avoids unnecessary redundancy: metadata was set in multiple places - sending no longer read information | 23 April 2020, 14:35:05 UTC |
d1a244c | Antoine Lambert | 23 April 2020, 12:56:06 UTC | pytest.ini: Avoid loading flask plugin to prevent fixture name clash pytest-django and pytest-flask both declare a fixture named client and the wrong one is picked when running swh-deposit tests. So avoid the loading of pytest flask plugin to prevent errors when running tests. | 23 April 2020, 12:56:44 UTC |
b91abac | Antoine R. Dumont (@ardumont) | 20 April 2020, 15:31:37 UTC | setup: Update the minimum required runtime python3 version Related to T2367 | 20 April 2020, 15:31:37 UTC |
4ffc7bc | Stefano Zacchiroli | 17 April 2020, 14:27:17 UTC | spec: reference SWHID using explicit anchors | 17 April 2020, 14:27:17 UTC |
dfd33d2 | Nicolas Dandrimont | 08 April 2020, 18:40:06 UTC | Update type annotations and signatures to match djangorestframework-stubs I noticed this because my virtualenv ended up with the djangorestframework-stubs package installed, which made the mypy pre-commit hook fail. This commit adds drf-stubs to the tox.ini, and does the relevant updates to our type annotations/signatures. Turns out that upstream DRF has all `request` parameters named that way, so we rename all our `req` parameters to match, which appeases mypy's signature checks. | 08 April 2020, 21:49:37 UTC |
1bc1732 | David Douard | 08 April 2020, 20:16:50 UTC | Add a pyproject.toml file to target py37 for black | 08 April 2020, 20:16:50 UTC |
f5426d6 | David Douard | 08 April 2020, 13:47:29 UTC | Enable black - blackify all the python files, - enable black in pre-commit, - add a black tox environment. | 08 April 2020, 13:47:29 UTC |
4b5b68a | Antoine R. Dumont (@ardumont) | 23 January 2020, 13:00:18 UTC | tests: Adapt init_sentry api change call with environment parameter New latest release on swh.core added the environment parameter. This will fix the current broken jenkins build [1] [1] https://jenkins.softwareheritage.org/job/DDEP/job/tests/658/console | 23 January 2020, 13:00:18 UTC |
9ab6047 | Antoine Lambert | 17 January 2020, 16:43:31 UTC | docs: Fix sphinx warnings Related to T2188 | 17 January 2020, 16:43:31 UTC |
fbbf6e7 | Antoine Lambert | 16 January 2020, 17:08:15 UTC | tests/gunicorn_config: Fix tests after recent changes in swh-core Those tests were broken since rDCORE2255767b9763cefe0841a8d0231f568adcec87ff. | 16 January 2020, 17:08:15 UTC |
8e63afd | Jenkins for Software Heritage | 13 January 2020, 11:07:52 UTC | New upstream version 0.0.81 | 13 January 2020, 11:07:52 UTC |
4244824 | David Douard | 13 January 2020, 10:44:17 UTC | Fix an order-related eventual fail in test_deposit_private_read_archive.py | 13 January 2020, 10:44:17 UTC |
75e7385 | David Douard | 10 January 2020, 14:43:19 UTC | Make tests pass with django 2 For this we: - ensure we create the DepositRequest with str as raw_metadata (instead of a bytes), and - make atom_dataset return a str instead of a bytes Every time this chunk of data is sent on the wire (http req to the django app) this needs to be an str, otherwise we have things like: raw_metadata = "b'[...]'" especially when testing against django 2, which is the only django version available on debian sid, so this is needed to make it possible to build the deb file on sid *with* tests enabled. - add a py3-django2 environment in tox - bump the dependency to django <3 in requirements-server.txt (otherwise it will take precendence on the deps: field of the tox file, thus execute tests in py3-django2 with django 1.11). Note that no other tests than executing pytest have been done with django2, so do not expect it works flawlessly. | 10 January 2020, 15:59:44 UTC |
00eadef | David Douard | 10 January 2020, 10:41:20 UTC | Add tox.ini and pytest.ini in the MANIFEST.in file | 10 January 2020, 14:56:30 UTC |
8e8341b | Jenkins for Software Heritage | 09 January 2020, 15:00:30 UTC | New upstream version 0.0.80 | 09 January 2020, 15:00:30 UTC |
030a342 | David Douard | 09 January 2020, 10:08:50 UTC | Remove dependency on swh.loader.tar This later no longer exists. | 09 January 2020, 10:11:08 UTC |
19a10ba | David Douard | 08 January 2020, 12:20:57 UTC | api/private/read: use application/zip as content_type for the sake of consistency. | 08 January 2020, 12:23:46 UTC |
90a5072 | David Douard | 08 January 2020, 12:17:19 UTC | api/private/read: use shutil.make_archive directly to generate the zip file this code was the only user for the swh.core.tarball.compress function. Doing so allows to reduce a bit the complexity and coupligin in the code. It will also allow to get rid of the swh.core.tarball.compress function. | 08 January 2020, 12:23:46 UTC |
5e68684 | David Douard | 07 January 2020, 09:25:21 UTC | Rename deposit/client/__init__.py as deposit/client.py No need for this to be a subpackage. | 08 January 2020, 12:23:46 UTC |
fc097da | Valentin Lorentz | 19 December 2019, 14:13:34 UTC | Update documentation of --author to use names instead of emails. This reflects what is done in practice and what the code expects. Using an email is invalid because the value of --author is used in a `http://schema.org/name` property, not `http://schema.org/email` | 07 January 2020, 10:43:01 UTC |
c8cf77b | David Douard | 20 December 2019, 11:06:25 UTC | cli/client: add a --format option to cli client commands This new option allows these cli commands (upload and status) to produce JSON or YAML output, so it's easier to test. | 20 December 2019, 11:17:49 UTC |
5a63595 | David Douard | 19 December 2019, 08:18:21 UTC | tests: make tests run with a proper scheduler so the scheduler interaction code is executed. Note that this does not test for correctness in these interactions yet. also move tests/__init__.py content in tests/conftest.py and adapt test code accordingly. This also ensures retries_left is set otherwise tests may fail when using the local sheduler. | 20 December 2019, 11:09:17 UTC |
6477259 | David Douard | 17 December 2019, 14:21:27 UTC | conftest: use pytest-postgresql for django related tests Replace the (non-working) django init hook by overloaded django_db_setup and make this django_db_setup use pytest-postgresql so we do not depend on external test environment (running postgresql server, tox or hand managed pifpaf). | 20 December 2019, 11:09:17 UTC |
3edb913 | David Douard | 16 December 2019, 12:02:28 UTC | Always generate a zip file from uploaded archives even if there is only one of those, otherwise the loader will fail since this later does expect the archive to be a zip file. | 20 December 2019, 11:09:17 UTC |
00cc608 | David Douard | 16 December 2019, 11:56:14 UTC | Move load-deposit task creation code in the deposit-check private API endpoint Also replace utils.origin_url_from() by a Deposit.origin_url property, and ensure the archive file format of the uploaded file is supported. The rename of invalid.tar.gz as invalid.gz is required for tests to pass which should not be the case. It will be investigated in a later revision, but for now we want tests to be green. This requires to make config dict available in SWHPrivateAPIView so we can have access to a scheduler from there. | 20 December 2019, 11:09:08 UTC |
5c85e6d | David Douard | 11 December 2019, 09:42:48 UTC | Make load-deposit and check-deposit URL argument absolute ensuring these generalted URLs are correct and resolvable (eg. when the WSGI app is mounted on a different path than /). This needed to move the post_deposit_save code from a signal directly within the view, so we have a request from which we can forge absolute URLs. | 20 December 2019, 11:08:17 UTC |
5d26b24 | Jenkins for Software Heritage | 19 December 2019, 16:42:26 UTC | New upstream version 0.0.79 | 19 December 2019, 16:42:26 UTC |
76fc968 | Valentin Lorentz | 19 December 2019, 14:13:34 UTC | Update documentation of --author to use names instead of emails. This reflects what is done in practice and what the code expects. Using an email is invalid because the value of --author is used in a `http://schema.org/name` property, not `http://schema.org/email` | 19 December 2019, 14:13:46 UTC |
e25693b | Valentin Lorentz | 18 December 2019, 17:56:16 UTC | Improve validation of --author and --name. Mostly, the code used to allow having either --author or --name, while it should use either both (when generating metadata) or neither (when using a metadata file). This code fixes this, and also catches some more invalid cases. | 19 December 2019, 14:01:02 UTC |
05be3e6 | Valentin Lorentz | 18 December 2019, 17:32:27 UTC | Clean temporary file handling for metadata generation, and add test. This uses a context-manager instead of manually handling removing the file. | 19 December 2019, 13:59:53 UTC |
78fd892 | Valentin Lorentz | 17 December 2019, 18:11:18 UTC | Start writing tests for the deposit upload CLI. | 19 December 2019, 12:41:32 UTC |
42ed3e1 | Valentin Lorentz | 17 December 2019, 18:09:25 UTC | Fix log level + status code of the client CLI in case of error. 'return' statements were ignored, and log level was too low for an error. | 18 December 2019, 10:23:53 UTC |
eb2631a | Valentin Lorentz | 17 December 2019, 18:06:25 UTC | Make the atom_dataset fixture available to all tests. | 18 December 2019, 10:23:53 UTC |
0c1a59c | Valentin Lorentz | 11 December 2019, 14:47:43 UTC | Add sentry integration. | 18 December 2019, 10:23:53 UTC |
68d4b86 | Antoine R. Dumont (@ardumont) | 12 December 2019, 14:20:14 UTC | deposit.tests: Cleanup some more dead code Related to 0a9ec2a | 12 December 2019, 14:20:14 UTC |
49f6d75 | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:50:39 UTC | deposit.signals: Remove compatibility code The deposit service only sends message for the current new deposit loader. | 06 December 2019, 11:35:17 UTC |
0a9ec2a | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:50:20 UTC | deposit.loader: Remove no longer used deprecated loader | 06 December 2019, 11:35:17 UTC |
05ad781 | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:25:33 UTC | deposit.api: Add a basic api page to avoid broken link Related to T2140 | 06 December 2019, 11:26:59 UTC |
101110f | Antoine R. Dumont (@ardumont) | 06 December 2019, 08:25:17 UTC | deposit.urls: Improve module docstring | 06 December 2019, 11:26:04 UTC |
b44057e | Antoine R. Dumont (@ardumont) | 06 December 2019, 07:59:29 UTC | homepage: Improve sentence phrasing | 06 December 2019, 11:26:04 UTC |
19fefb7 | Antoine Lambert | 03 December 2019, 14:29:47 UTC | requirements: Pin mypy and django-stubs version Current djangos-stubs version (1.2.0) is not compatible with latest mypy one (0.750). So pin their version until the issue is fixed. | 03 December 2019, 14:30:04 UTC |
0346e1a | Jenkins for Software Heritage | 25 November 2019, 17:34:32 UTC | New upstream version 0.0.78 | 25 November 2019, 17:34:32 UTC |
a51bf9b | Antoine R. Dumont (@ardumont) | 25 November 2019, 17:27:57 UTC | deposit.signal: Simplify configuration entry | 25 November 2019, 17:27:57 UTC |
8f0b7b6 | Jenkins for Software Heritage | 25 November 2019, 14:02:36 UTC | New upstream version 0.0.77 | 25 November 2019, 14:02:36 UTC |
7e42142 | Antoine R. Dumont (@ardumont) | 25 November 2019, 13:47:05 UTC | mypy: Fix missing import | 25 November 2019, 13:47:52 UTC |
5e95af9 | Antoine R. Dumont (@ardumont) | 25 November 2019, 13:47:14 UTC | deposit.signals: Send versioned scheduler tasks | 25 November 2019, 13:47:52 UTC |
a02b812 | Jenkins for Software Heritage | 25 November 2019, 11:29:46 UTC | New upstream version 0.0.76 | 25 November 2019, 11:29:46 UTC |
7b513a6 | Antoine R. Dumont (@ardumont) | 04 October 2019, 14:11:02 UTC | deposit.signals: Scheduler load-deposit task with new endpoints Related T2024 | 25 November 2019, 11:27:34 UTC |
b646d12 | David Douard | 21 November 2019, 16:53:53 UTC | Fix migration scripts for 80 column lines so pre-commit is happy. | 21 November 2019, 16:53:53 UTC |
3aeae79 | David Douard | 21 November 2019, 13:12:44 UTC | Add a pre-commit config file | 21 November 2019, 16:53:09 UTC |
399b0d7 | Nicolas Dandrimont | 21 November 2019, 10:55:12 UTC | Migrate tox.ini to extras = xxx instead of deps = .[testing] | 21 November 2019, 10:55:12 UTC |
3c1930d | Nicolas Dandrimont | 21 November 2019, 10:54:38 UTC | Merge tox environment configuration | 21 November 2019, 10:54:38 UTC |
cbf523d | Nicolas Dandrimont | 21 November 2019, 10:52:39 UTC | Remove pytest<4 version constraint | 21 November 2019, 10:52:58 UTC |
b2ee4e9 | Nicolas Dandrimont | 20 November 2019, 18:56:38 UTC | Include all requirements in MANIFEST.in | 20 November 2019, 18:56:38 UTC |
45a982d | Stefano Zacchiroli | 07 November 2019, 12:42:49 UTC | Makefile.local: port to new swh-environment typecheck naming | 07 November 2019, 12:42:49 UTC |
39d1241 | Stefano Zacchiroli | 07 November 2019, 08:30:38 UTC | mypy: properly type get/put methods, as well deposit_requests_types dict | 07 November 2019, 08:30:38 UTC |
dd06930 | Stefano Zacchiroli | 07 November 2019, 08:24:27 UTC | tox.ini: pass DJANGO_SETTINGS_MODULE to mypy environment hat tip to @anlambert for the tip | 07 November 2019, 08:24:27 UTC |
17b3ee4 | Stefano Zacchiroli | 01 November 2019, 14:35:49 UTC | mypy: ignore psycopg2 | 01 November 2019, 14:35:49 UTC |
4bb1de4 | Stefano Zacchiroli | 01 November 2019, 14:35:26 UTC | Makefile.local: sync typecheck target with global Makefile.python | 01 November 2019, 14:35:26 UTC |
00440eb | Stefano Zacchiroli | 01 November 2019, 10:56:51 UTC | requirements-test.txt: add back deps from master | 01 November 2019, 10:56:51 UTC |
34153ef | Stefano Zacchiroli | 01 October 2019, 10:28:25 UTC | tox: add mypy environment | 01 November 2019, 10:55:36 UTC |
422b92f | Stefano Zacchiroli | 27 September 2019, 08:33:01 UTC | init.py: switch to documented way of extending path make mypy 0.730 pass cleanly again | 01 November 2019, 10:55:36 UTC |
0b3d526 | Stefano Zacchiroli | 25 September 2019, 09:41:27 UTC | typing: convert leftover variable annotation to comments | 01 November 2019, 10:55:36 UTC |
fd8db57 | Stefano Zacchiroli | 24 September 2019, 09:02:11 UTC | typing: minimal changes to make a no-op mypy run pass | 01 November 2019, 10:55:36 UTC |
5912f43 | Jenkins for Software Heritage | 30 October 2019, 15:54:53 UTC | New upstream version 0.0.75 | 30 October 2019, 15:54:53 UTC |
eb60bf5 | Nicolas Dandrimont | 30 October 2019, 14:08:05 UTC | Revert "deposit.signals: Scheduler load-deposit task with new endpoints" This reverts commit 12e3966b168e7be7b19aeb8c0a8d664667c81b3d. | 30 October 2019, 14:08:05 UTC |
9b65a13 | Antoine R. Dumont (@ardumont) | 21 October 2019, 13:14:19 UTC | swh.deposit.tests: Drop dead code | 21 October 2019, 13:23:56 UTC |
7f3c655 | Antoine R. Dumont (@ardumont) | 21 October 2019, 11:23:40 UTC | tests.loader: Migrate to pytest | 21 October 2019, 13:23:56 UTC |
d5a394a | Antoine R. Dumont (@ardumont) | 21 October 2019, 10:11:06 UTC | tests.checker: Migrate to pytest | 21 October 2019, 13:23:56 UTC |
89a466e | Antoine R. Dumont (@ardumont) | 21 October 2019, 09:08:44 UTC | tests.loader: Migrate test_client to pytest | 21 October 2019, 13:23:56 UTC |
44f5906 | Antoine R. Dumont (@ardumont) | 21 October 2019, 07:22:57 UTC | tox.ini: Update tox.ini requirements | 21 October 2019, 13:23:56 UTC |
1ad0bf5 | Antoine R. Dumont (@ardumont) | 20 October 2019, 22:59:36 UTC | tests_deposit_private_read_metadata: Migrate to pytest | 20 October 2019, 22:59:36 UTC |
771ffae | Antoine R. Dumont (@ardumont) | 20 October 2019, 18:10:13 UTC | tests_deposit_private_read_archive: Migrate to pytest | 20 October 2019, 18:10:13 UTC |
29b30d4 | Antoine R. Dumont (@ardumont) | 20 October 2019, 17:33:55 UTC | tests_deposit_private_update_status: Migrate to pytest | 20 October 2019, 17:33:55 UTC |
8d49c14 | Antoine R. Dumont (@ardumont) | 20 October 2019, 15:39:30 UTC | tests_deposit_private_check: Migrate to pytest | 20 October 2019, 17:33:48 UTC |
2de3ee3 | Antoine R. Dumont (@ardumont) | 20 October 2019, 15:31:19 UTC | test_deposit_update: Migrate to pytest | 20 October 2019, 15:31:19 UTC |
dd68e9a | Antoine R. Dumont (@ardumont) | 20 October 2019, 13:54:29 UTC | test_deposit: Migrate to pytest Also add more tests on the deposit parent build scenario. | 20 October 2019, 13:54:29 UTC |
370f00c | Antoine R. Dumont (@ardumont) | 20 October 2019, 12:08:07 UTC | test_deposit_multipart: Migrate to pytest | 20 October 2019, 12:08:07 UTC |
19e290f | Antoine R. Dumont (@ardumont) | 20 October 2019, 09:56:21 UTC | test_deposit_delete: Migrate to pytest | 20 October 2019, 09:56:21 UTC |
486f155 | Antoine R. Dumont (@ardumont) | 20 October 2019, 09:16:04 UTC | test_deposit_binary: Migrate to pytest | 20 October 2019, 09:56:11 UTC |
981d1fa | Antoine R. Dumont (@ardumont) | 20 October 2019, 08:23:15 UTC | test_deposit_atom: Migrate to pytest | 20 October 2019, 08:23:15 UTC |
6b5dbdb | Antoine R. Dumont (@ardumont) | 20 October 2019, 06:49:00 UTC | test_deposit_list: Migrate to pytest | 20 October 2019, 08:23:08 UTC |
ddd9b4f | Antoine R. Dumont (@ardumont) | 19 October 2019, 18:00:39 UTC | test_deposit_status: Migrate to pytest | 20 October 2019, 06:18:44 UTC |
9adb050 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:46:07 UTC | tests: Fix pep8 violations | 19 October 2019, 17:46:07 UTC |
d491b64 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:39:35 UTC | test.api.service_document: Migrate to pytest tests | 19 October 2019, 17:45:30 UTC |
9b9e9c7 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:36:09 UTC | test.loader.conftest: Add missing headers | 19 October 2019, 17:45:30 UTC |
e252566 | Antoine R. Dumont (@ardumont) | 19 October 2019, 17:35:57 UTC | pytest.ini: Add markers to remove pytest warnings | 19 October 2019, 17:45:30 UTC |
680b062 | Antoine R. Dumont (@ardumont) | 19 October 2019, 15:50:49 UTC | test_parser: Migrate to pytest tests | 19 October 2019, 17:45:30 UTC |
dc36c99 | Antoine R. Dumont (@ardumont) | 19 October 2019, 15:46:34 UTC | Start migrate tests to pytest-django That also fix the pytest tests run | 19 October 2019, 17:45:29 UTC |
a1d7932 | Antoine R. Dumont (@ardumont) | 19 October 2019, 14:25:23 UTC | tests_utils: Migrate to pytest tests | 19 October 2019, 14:25:30 UTC |
6ff940c | Antoine R. Dumont (@ardumont) | 19 October 2019, 14:17:17 UTC | tests_converters: Migrate to pytest | 19 October 2019, 14:25:17 UTC |