https://forge.softwareheritage.org/source/swh-deposit.git

sort by:
Revision Author Date Message Commit Date
25d7f75 test: Add checks scenario test cases 07 May 2020, 13:30:12 UTC
108fa11 test_tasks: Unify mocking using pytest-mock fixture 07 May 2020, 13:09:04 UTC
cd9c642 test_task: Mark it to be ignore during debian build 07 May 2020, 13:04:17 UTC
d255958 Pass collection + id to the checker instead of an URL. This allows the checker to use a configurable URL, in case it needs an URL different from the one used by the client. For example a client outside docker would use http://localhost:5080/deposit/ to access the API, but the checker cannot use this URL (it needs either nginx or swh-deposit as hostname). 06 May 2020, 10:46:41 UTC
cb6bc3a Add a test checking a check-deposit task is created. That code was not covered so far. 04 May 2020, 12:54:28 UTC
e979f58 setup.py: add documentation link 29 April 2020, 16:30:57 UTC
4752ab9 deposit_read: Simplify api to return only relevant deposit information This avoids: - avoids unnecessary redundancy: metadata was set in multiple places - sending no longer read information 23 April 2020, 14:35:05 UTC
d1a244c pytest.ini: Avoid loading flask plugin to prevent fixture name clash pytest-django and pytest-flask both declare a fixture named client and the wrong one is picked when running swh-deposit tests. So avoid the loading of pytest flask plugin to prevent errors when running tests. 23 April 2020, 12:56:44 UTC
b91abac setup: Update the minimum required runtime python3 version Related to T2367 20 April 2020, 15:31:37 UTC
4ffc7bc spec: reference SWHID using explicit anchors 17 April 2020, 14:27:17 UTC
dfd33d2 Update type annotations and signatures to match djangorestframework-stubs I noticed this because my virtualenv ended up with the djangorestframework-stubs package installed, which made the mypy pre-commit hook fail. This commit adds drf-stubs to the tox.ini, and does the relevant updates to our type annotations/signatures. Turns out that upstream DRF has all `request` parameters named that way, so we rename all our `req` parameters to match, which appeases mypy's signature checks. 08 April 2020, 21:49:37 UTC
1bc1732 Add a pyproject.toml file to target py37 for black 08 April 2020, 20:16:50 UTC
f5426d6 Enable black - blackify all the python files, - enable black in pre-commit, - add a black tox environment. 08 April 2020, 13:47:29 UTC
4b5b68a tests: Adapt init_sentry api change call with environment parameter New latest release on swh.core added the environment parameter. This will fix the current broken jenkins build [1] [1] https://jenkins.softwareheritage.org/job/DDEP/job/tests/658/console 23 January 2020, 13:00:18 UTC
9ab6047 docs: Fix sphinx warnings Related to T2188 17 January 2020, 16:43:31 UTC
fbbf6e7 tests/gunicorn_config: Fix tests after recent changes in swh-core Those tests were broken since rDCORE2255767b9763cefe0841a8d0231f568adcec87ff. 16 January 2020, 17:08:15 UTC
4244824 Fix an order-related eventual fail in test_deposit_private_read_archive.py 13 January 2020, 10:44:17 UTC
75e7385 Make tests pass with django 2 For this we: - ensure we create the DepositRequest with str as raw_metadata (instead of a bytes), and - make atom_dataset return a str instead of a bytes Every time this chunk of data is sent on the wire (http req to the django app) this needs to be an str, otherwise we have things like: raw_metadata = "b'[...]'" especially when testing against django 2, which is the only django version available on debian sid, so this is needed to make it possible to build the deb file on sid *with* tests enabled. - add a py3-django2 environment in tox - bump the dependency to django <3 in requirements-server.txt (otherwise it will take precendence on the deps: field of the tox file, thus execute tests in py3-django2 with django 1.11). Note that no other tests than executing pytest have been done with django2, so do not expect it works flawlessly. 10 January 2020, 15:59:44 UTC
00eadef Add tox.ini and pytest.ini in the MANIFEST.in file 10 January 2020, 14:56:30 UTC
030a342 Remove dependency on swh.loader.tar This later no longer exists. 09 January 2020, 10:11:08 UTC
19a10ba api/private/read: use application/zip as content_type for the sake of consistency. 08 January 2020, 12:23:46 UTC
90a5072 api/private/read: use shutil.make_archive directly to generate the zip file this code was the only user for the swh.core.tarball.compress function. Doing so allows to reduce a bit the complexity and coupligin in the code. It will also allow to get rid of the swh.core.tarball.compress function. 08 January 2020, 12:23:46 UTC
5e68684 Rename deposit/client/__init__.py as deposit/client.py No need for this to be a subpackage. 08 January 2020, 12:23:46 UTC
fc097da Update documentation of --author to use names instead of emails. This reflects what is done in practice and what the code expects. Using an email is invalid because the value of --author is used in a `http://schema.org/name` property, not `http://schema.org/email` 07 January 2020, 10:43:01 UTC
c8cf77b cli/client: add a --format option to cli client commands This new option allows these cli commands (upload and status) to produce JSON or YAML output, so it's easier to test. 20 December 2019, 11:17:49 UTC
5a63595 tests: make tests run with a proper scheduler so the scheduler interaction code is executed. Note that this does not test for correctness in these interactions yet. also move tests/__init__.py content in tests/conftest.py and adapt test code accordingly. This also ensures retries_left is set otherwise tests may fail when using the local sheduler. 20 December 2019, 11:09:17 UTC
6477259 conftest: use pytest-postgresql for django related tests Replace the (non-working) django init hook by overloaded django_db_setup and make this django_db_setup use pytest-postgresql so we do not depend on external test environment (running postgresql server, tox or hand managed pifpaf). 20 December 2019, 11:09:17 UTC
3edb913 Always generate a zip file from uploaded archives even if there is only one of those, otherwise the loader will fail since this later does expect the archive to be a zip file. 20 December 2019, 11:09:17 UTC
00cc608 Move load-deposit task creation code in the deposit-check private API endpoint Also replace utils.origin_url_from() by a Deposit.origin_url property, and ensure the archive file format of the uploaded file is supported. The rename of invalid.tar.gz as invalid.gz is required for tests to pass which should not be the case. It will be investigated in a later revision, but for now we want tests to be green. This requires to make config dict available in SWHPrivateAPIView so we can have access to a scheduler from there. 20 December 2019, 11:09:08 UTC
5c85e6d Make load-deposit and check-deposit URL argument absolute ensuring these generalted URLs are correct and resolvable (eg. when the WSGI app is mounted on a different path than /). This needed to move the post_deposit_save code from a signal directly within the view, so we have a request from which we can forge absolute URLs. 20 December 2019, 11:08:17 UTC
e25693b Improve validation of --author and --name. Mostly, the code used to allow having either --author or --name, while it should use either both (when generating metadata) or neither (when using a metadata file). This code fixes this, and also catches some more invalid cases. 19 December 2019, 14:01:02 UTC
05be3e6 Clean temporary file handling for metadata generation, and add test. This uses a context-manager instead of manually handling removing the file. 19 December 2019, 13:59:53 UTC
78fd892 Start writing tests for the deposit upload CLI. 19 December 2019, 12:41:32 UTC
42ed3e1 Fix log level + status code of the client CLI in case of error. 'return' statements were ignored, and log level was too low for an error. 18 December 2019, 10:23:53 UTC
eb2631a Make the atom_dataset fixture available to all tests. 18 December 2019, 10:23:53 UTC
0c1a59c Add sentry integration. 18 December 2019, 10:23:53 UTC
68d4b86 deposit.tests: Cleanup some more dead code Related to 0a9ec2a 12 December 2019, 14:20:14 UTC
49f6d75 deposit.signals: Remove compatibility code The deposit service only sends message for the current new deposit loader. 06 December 2019, 11:35:17 UTC
0a9ec2a deposit.loader: Remove no longer used deprecated loader 06 December 2019, 11:35:17 UTC
05ad781 deposit.api: Add a basic api page to avoid broken link Related to T2140 06 December 2019, 11:26:59 UTC
101110f deposit.urls: Improve module docstring 06 December 2019, 11:26:04 UTC
b44057e homepage: Improve sentence phrasing 06 December 2019, 11:26:04 UTC
19fefb7 requirements: Pin mypy and django-stubs version Current djangos-stubs version (1.2.0) is not compatible with latest mypy one (0.750). So pin their version until the issue is fixed. 03 December 2019, 14:30:04 UTC
a51bf9b deposit.signal: Simplify configuration entry 25 November 2019, 17:27:57 UTC
7e42142 mypy: Fix missing import 25 November 2019, 13:47:52 UTC
5e95af9 deposit.signals: Send versioned scheduler tasks 25 November 2019, 13:47:52 UTC
7b513a6 deposit.signals: Scheduler load-deposit task with new endpoints Related T2024 25 November 2019, 11:27:34 UTC
b646d12 Fix migration scripts for 80 column lines so pre-commit is happy. 21 November 2019, 16:53:53 UTC
3aeae79 Add a pre-commit config file 21 November 2019, 16:53:09 UTC
399b0d7 Migrate tox.ini to extras = xxx instead of deps = .[testing] 21 November 2019, 10:55:12 UTC
3c1930d Merge tox environment configuration 21 November 2019, 10:54:38 UTC
cbf523d Remove pytest<4 version constraint 21 November 2019, 10:52:58 UTC
b2ee4e9 Include all requirements in MANIFEST.in 20 November 2019, 18:56:38 UTC
45a982d Makefile.local: port to new swh-environment typecheck naming 07 November 2019, 12:42:49 UTC
39d1241 mypy: properly type get/put methods, as well deposit_requests_types dict 07 November 2019, 08:30:38 UTC
dd06930 tox.ini: pass DJANGO_SETTINGS_MODULE to mypy environment hat tip to @anlambert for the tip 07 November 2019, 08:24:27 UTC
17b3ee4 mypy: ignore psycopg2 01 November 2019, 14:35:49 UTC
4bb1de4 Makefile.local: sync typecheck target with global Makefile.python 01 November 2019, 14:35:26 UTC
00440eb requirements-test.txt: add back deps from master 01 November 2019, 10:56:51 UTC
34153ef tox: add mypy environment 01 November 2019, 10:55:36 UTC
422b92f init.py: switch to documented way of extending path make mypy 0.730 pass cleanly again 01 November 2019, 10:55:36 UTC
0b3d526 typing: convert leftover variable annotation to comments 01 November 2019, 10:55:36 UTC
fd8db57 typing: minimal changes to make a no-op mypy run pass 01 November 2019, 10:55:36 UTC
eb60bf5 Revert "deposit.signals: Scheduler load-deposit task with new endpoints" This reverts commit 12e3966b168e7be7b19aeb8c0a8d664667c81b3d. 30 October 2019, 14:08:05 UTC
9b65a13 swh.deposit.tests: Drop dead code 21 October 2019, 13:23:56 UTC
7f3c655 tests.loader: Migrate to pytest 21 October 2019, 13:23:56 UTC
d5a394a tests.checker: Migrate to pytest 21 October 2019, 13:23:56 UTC
89a466e tests.loader: Migrate test_client to pytest 21 October 2019, 13:23:56 UTC
44f5906 tox.ini: Update tox.ini requirements 21 October 2019, 13:23:56 UTC
1ad0bf5 tests_deposit_private_read_metadata: Migrate to pytest 20 October 2019, 22:59:36 UTC
771ffae tests_deposit_private_read_archive: Migrate to pytest 20 October 2019, 18:10:13 UTC
29b30d4 tests_deposit_private_update_status: Migrate to pytest 20 October 2019, 17:33:55 UTC
8d49c14 tests_deposit_private_check: Migrate to pytest 20 October 2019, 17:33:48 UTC
2de3ee3 test_deposit_update: Migrate to pytest 20 October 2019, 15:31:19 UTC
dd68e9a test_deposit: Migrate to pytest Also add more tests on the deposit parent build scenario. 20 October 2019, 13:54:29 UTC
370f00c test_deposit_multipart: Migrate to pytest 20 October 2019, 12:08:07 UTC
19e290f test_deposit_delete: Migrate to pytest 20 October 2019, 09:56:21 UTC
486f155 test_deposit_binary: Migrate to pytest 20 October 2019, 09:56:11 UTC
981d1fa test_deposit_atom: Migrate to pytest 20 October 2019, 08:23:15 UTC
6b5dbdb test_deposit_list: Migrate to pytest 20 October 2019, 08:23:08 UTC
ddd9b4f test_deposit_status: Migrate to pytest 20 October 2019, 06:18:44 UTC
9adb050 tests: Fix pep8 violations 19 October 2019, 17:46:07 UTC
d491b64 test.api.service_document: Migrate to pytest tests 19 October 2019, 17:45:30 UTC
9b9e9c7 test.loader.conftest: Add missing headers 19 October 2019, 17:45:30 UTC
e252566 pytest.ini: Add markers to remove pytest warnings 19 October 2019, 17:45:30 UTC
680b062 test_parser: Migrate to pytest tests 19 October 2019, 17:45:30 UTC
dc36c99 Start migrate tests to pytest-django That also fix the pytest tests run 19 October 2019, 17:45:29 UTC
a1d7932 tests_utils: Migrate to pytest tests 19 October 2019, 14:25:30 UTC
6ff940c tests_converters: Migrate to pytest 19 October 2019, 14:25:17 UTC
2c31d21 Use @shared_task decorator instead of binding to specific celery app 19 October 2019, 14:16:26 UTC
5dfbeac Remove indirection swh.deposit.wsgi to start server Related f147893 Related D2109 10 October 2019, 08:25:49 UTC
12e3966 deposit.signals: Scheduler load-deposit task with new endpoints Related T2024 04 October 2019, 16:01:17 UTC
86bc253 tests: Explicit private tests in their names 04 October 2019, 14:12:41 UTC
b762b98 deposit.private.api: Expose new endpoints with no collection name This is not used. Related T2024 04 October 2019, 14:12:32 UTC
2499370 models: add migration to on_delete=protect 25 September 2019, 09:07:29 UTC
260de31 models: add required on_delete kwarg to ForeignKey courtesy of mypy 24 September 2019, 09:02:43 UTC
8f39669 admin CLI: avoid redefining deposit name in admin subcommand 19 September 2019, 13:59:44 UTC
11f8bbb click "required" param wants bool, not int courtesy of mypy 17 September 2019, 06:55:48 UTC
cae84fc fix typos in docstrings and docs courtesy of codespell 16 September 2019, 15:19:12 UTC
c40f076 setup: register the worker task in the swh.workers entrypoint 05 September 2019, 07:51:30 UTC
back to top