eddde8d | Jenkins for Software Heritage | 06 December 2019, 10:26:00 UTC | Updated backport on buster-swh from debian/0.0.160-1_swh1 (unstable-swh) | 06 December 2019, 10:26:00 UTC |
f38725c | Jenkins for Software Heritage | 06 December 2019, 10:25:59 UTC | Merge tag 'debian/0.0.160-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.160-1~swh1 # Conflicts: # debian/changelog | 06 December 2019, 10:25:59 UTC |
acea3fe | Jenkins for Software Heritage | 06 December 2019, 10:23:44 UTC | Updated debian changelog for version 0.0.160 | 06 December 2019, 10:23:44 UTC |
4069ebc | Jenkins for Software Heritage | 06 December 2019, 10:23:43 UTC | Update upstream source from tag 'debian/upstream/0.0.160' Update to upstream version '0.0.160' with Debian dir e9e59c3afba4f2a3101a98a32398ba5402f4d4fc | 06 December 2019, 10:23:43 UTC |
0599649 | Jenkins for Software Heritage | 06 December 2019, 10:23:42 UTC | New upstream version 0.0.160 | 06 December 2019, 10:23:42 UTC |
bee73be | Antoine R. Dumont (@ardumont) | 06 December 2019, 10:11:52 UTC | storage.buffer: Buffer release objects as well | 06 December 2019, 10:11:52 UTC |
382e500 | Antoine R. Dumont (@ardumont) | 06 December 2019, 10:11:25 UTC | storage.tests: Unify tests sample data | 06 December 2019, 10:11:25 UTC |
aa65c42 | Jenkins for Software Heritage | 26 November 2019, 16:12:45 UTC | Updated backport on buster-swh from debian/0.0.159-1_swh2 (unstable-swh) | 26 November 2019, 16:12:45 UTC |
64685dc | Jenkins for Software Heritage | 26 November 2019, 16:12:44 UTC | Merge tag 'debian/0.0.159-1_swh2' into debian/buster-swh swh-storage Debian release 0.0.159-1~swh2 # gpg: Signature made Tue Nov 26 16:10:02 2019 UTC # gpg: using RSA key BF00203D741AC9D546A8BE0752E2E9840D10C3B8 # gpg: Can't check signature: No public key # Conflicts: # debian/changelog | 26 November 2019, 16:12:44 UTC |
0e23408 | Antoine R. Dumont (@ardumont) | 26 November 2019, 16:09:38 UTC | d/changelog: Bump version | 26 November 2019, 16:09:38 UTC |
d233974 | Antoine Lambert | 26 November 2019, 14:30:05 UTC | debian/rules: Force fast hypothesis profile when running tests | 26 November 2019, 14:30:05 UTC |
27281e8 | Antoine Lambert | 26 November 2019, 14:21:02 UTC | Makefile.local: Fix test target execution Explicitly pass tests folder as paramter when invoking pytest in order for the hypothesis profiles to be found. | 26 November 2019, 14:22:36 UTC |
2cac339 | Nicolas Dandrimont | 22 November 2019, 17:27:52 UTC | Implement origin lookup by sha1 Close T2045. | 25 November 2019, 14:18:44 UTC |
0fcb8bc | Valentin Lorentz | 22 November 2019, 15:08:37 UTC | Get rid of warnings about the 'args' argument to get_storage. | 22 November 2019, 15:08:37 UTC |
c294b73 | Valentin Lorentz | 22 November 2019, 12:23:54 UTC | Remove/fix wrong comments. | 22 November 2019, 12:23:54 UTC |
68482bb | Jenkins for Software Heritage | 22 November 2019, 10:10:31 UTC | Updated debian changelog for version 0.0.159 | 22 November 2019, 10:10:31 UTC |
1c9119c | Jenkins for Software Heritage | 22 November 2019, 10:10:30 UTC | Update upstream source from tag 'debian/upstream/0.0.159' Update to upstream version '0.0.159' with Debian dir 248b0a0d38fcfc84e3f5b2af06e628a0e81ac769 | 22 November 2019, 10:10:30 UTC |
6c99bca | Jenkins for Software Heritage | 22 November 2019, 10:10:29 UTC | New upstream version 0.0.159 | 22 November 2019, 10:10:29 UTC |
a3fd826 | Nicolas Dandrimont | 21 November 2019, 13:10:29 UTC | Migrate tox.ini to extras = xxx instead of deps = .[testing] | 21 November 2019, 13:10:29 UTC |
1594e25 | Nicolas Dandrimont | 21 November 2019, 13:07:08 UTC | Drop unused listener extra | 21 November 2019, 13:07:08 UTC |
df4df8b | Nicolas Dandrimont | 21 November 2019, 13:06:55 UTC | Merge tox test environment configurations | 21 November 2019, 13:06:55 UTC |
06bd050 | Valentin Lorentz | 21 November 2019, 12:38:03 UTC | Deduplicate code of test_origin_get_range. | 21 November 2019, 12:38:03 UTC |
29eb548 | David Douard | 20 November 2019, 10:18:57 UTC | Fix a few typos reported by codespell | 21 November 2019, 12:16:51 UTC |
bc0e81c | David Douard | 20 November 2019, 10:17:40 UTC | pre-commit: explicitely whitelist 'iff' when running codespell | 21 November 2019, 12:16:51 UTC |
1472c8e | David Douard | 20 November 2019, 10:00:57 UTC | fix trailing ws reported by pre-commit | 21 November 2019, 12:16:51 UTC |
264cd33 | David Douard | 20 November 2019, 09:27:42 UTC | Add a pre-commit-hooks.yaml config file | 21 November 2019, 12:16:51 UTC |
a97db93 | David Douard | 20 November 2019, 10:25:51 UTC | Fix swh-storage-add-dir to please mypy, at least. | 21 November 2019, 10:19:43 UTC |
c787808 | David Douard | 20 November 2019, 10:19:26 UTC | Remove utils/(dump|fix)_revisions scripts these are now deprecated. | 21 November 2019, 10:19:43 UTC |
b337b4a | Valentin Lorentz | 14 November 2019, 13:16:49 UTC | Add 'pipeline' storage "class" for more readable configurations. This would allow writing configurations like: ``` storage: cls: pipeline steps: - cls: filter - cls: buffer - cls: remote url: http://swh-storage:5002/ ``` or ``` storage: cls: filter storage: cls: buffer storage: cls: remote url: http://swh-storage:5002/ ``` instead of: ``` storage: cls: filter args: storage: cls: buffer args: storage: cls: remote args: url: http://swh-storage:5002/ ``` | 19 November 2019, 03:16:39 UTC |
ea9aa47 | David Douard | 18 November 2019, 10:16:18 UTC | and not only for an existing origin visit. This is needed in situations where the snapshot table is not in sync with the origin_visit one; typically occurs on mirrors. Also add tests for with_visit argument. | 18 November 2019, 12:28:45 UTC |
2bce436 | Jenkins for Software Heritage | 14 November 2019, 12:39:30 UTC | Updated backport on buster-swh from debian/0.0.158-1_swh1 (unstable-swh) | 14 November 2019, 12:39:30 UTC |
9098e4d | Jenkins for Software Heritage | 14 November 2019, 12:39:30 UTC | Merge tag 'debian/0.0.158-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.158-1~swh1 # Conflicts: # debian/changelog | 14 November 2019, 12:39:30 UTC |
0671131 | Jenkins for Software Heritage | 14 November 2019, 12:37:18 UTC | Updated debian changelog for version 0.0.158 | 14 November 2019, 12:37:18 UTC |
be50ce8 | Jenkins for Software Heritage | 14 November 2019, 12:37:18 UTC | Update upstream source from tag 'debian/upstream/0.0.158' Update to upstream version '0.0.158' with Debian dir 9562b6097a9ae7290bfe958ec1acbf6ba4342db4 | 14 November 2019, 12:37:18 UTC |
2a46802 | Jenkins for Software Heritage | 14 November 2019, 12:37:16 UTC | New upstream version 0.0.158 | 14 November 2019, 12:37:16 UTC |
9b4d339 | Antoine R. Dumont (@ardumont) | 14 November 2019, 09:54:02 UTC | d/*: Remove python3-swh.storage.schemata package The modules no longer exists Related D2272 | 14 November 2019, 09:54:02 UTC |
e296dfb | Antoine R. Dumont (@ardumont) | 14 November 2019, 09:26:41 UTC | swh.storage.schemata: Drop schemata from storage As this got migrated back to the swh.lister module | 14 November 2019, 09:26:41 UTC |
0e7bec7 | Jenkins for Software Heritage | 13 November 2019, 12:29:16 UTC | Updated backport on buster-swh from debian/0.0.157-1_swh1 (unstable-swh) | 13 November 2019, 12:29:16 UTC |
4e2630c | Jenkins for Software Heritage | 13 November 2019, 12:29:16 UTC | Merge tag 'debian/0.0.157-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.157-1~swh1 # Conflicts: # debian/changelog | 13 November 2019, 12:29:16 UTC |
f2193c3 | Jenkins for Software Heritage | 13 November 2019, 12:27:07 UTC | Updated debian changelog for version 0.0.157 | 13 November 2019, 12:27:07 UTC |
07c7ce9 | Jenkins for Software Heritage | 13 November 2019, 12:27:06 UTC | Update upstream source from tag 'debian/upstream/0.0.157' Update to upstream version '0.0.157' with Debian dir ca1b4e56d7d3820b3368621c3d2d187e996b6892 | 13 November 2019, 12:27:06 UTC |
05d648e | Jenkins for Software Heritage | 13 November 2019, 12:27:05 UTC | New upstream version 0.0.157 | 13 November 2019, 12:27:05 UTC |
bb5d405 | Nicolas Dandrimont | 12 November 2019, 18:55:33 UTC | Add minimal test coverage for swh.storage.schemata | 13 November 2019, 12:08:27 UTC |
d788677 | Nicolas Dandrimont | 12 November 2019, 18:08:47 UTC | Fix bogus NotImplementedError on Area.index_uris This would raise when the iteration terminates even though the uris were generated. | 12 November 2019, 18:08:47 UTC |
94fa1bf | Jenkins for Software Heritage | 30 October 2019, 17:30:12 UTC | Updated backport on buster-swh from debian/0.0.156-1_swh2 (unstable-swh) | 30 October 2019, 17:30:12 UTC |
186cd53 | Jenkins for Software Heritage | 30 October 2019, 17:30:12 UTC | Merge tag 'debian/0.0.156-1_swh2' into debian/buster-swh swh-storage Debian release 0.0.156-1~swh2 # Conflicts: # debian/changelog | 30 October 2019, 17:30:12 UTC |
9908153 | Nicolas Dandrimont | 30 October 2019, 17:21:17 UTC | Add version constraint on psycopg2 | 30 October 2019, 17:21:42 UTC |
bd6a932 | Jenkins for Software Heritage | 30 October 2019, 17:13:43 UTC | Updated backport on buster-swh from debian/0.0.156-1_swh1 (unstable-swh) | 30 October 2019, 17:13:43 UTC |
6b5b76b | Jenkins for Software Heritage | 30 October 2019, 17:13:42 UTC | Merge tag 'debian/0.0.156-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.156-1~swh1 # Conflicts: # debian/changelog | 30 October 2019, 17:13:42 UTC |
69a3d42 | Jenkins for Software Heritage | 30 October 2019, 14:29:28 UTC | Updated debian changelog for version 0.0.156 | 30 October 2019, 14:29:28 UTC |
a211c7b | Jenkins for Software Heritage | 30 October 2019, 14:29:27 UTC | Update upstream source from tag 'debian/upstream/0.0.156' Update to upstream version '0.0.156' with Debian dir 51c2da75a276d10d50ebec212ad820f985c48dfa | 30 October 2019, 14:29:27 UTC |
67029e6 | Jenkins for Software Heritage | 30 October 2019, 14:29:26 UTC | New upstream version 0.0.156 | 30 October 2019, 14:29:26 UTC |
d4540ed | Valentin Lorentz | 30 October 2019, 13:35:09 UTC | Make visit['origin'] a string everywhere (instead of a dict). | 30 October 2019, 14:08:29 UTC |
0606791 | Valentin Lorentz | 25 October 2019, 11:03:26 UTC | Stop supporting origin ids in API (except in origin_get_range). | 30 October 2019, 13:13:40 UTC |
6f2e27c | Jenkins for Software Heritage | 30 October 2019, 11:18:37 UTC | Updated debian changelog for version 0.0.155 | 30 October 2019, 11:18:37 UTC |
5072307 | Jenkins for Software Heritage | 30 October 2019, 11:18:37 UTC | Update upstream source from tag 'debian/upstream/0.0.155' Update to upstream version '0.0.155' with Debian dir bba9f7b007530ff59ad1370a5c630025c5b820a3 | 30 October 2019, 11:18:37 UTC |
9064867 | Jenkins for Software Heritage | 30 October 2019, 11:18:36 UTC | New upstream version 0.0.155 | 30 October 2019, 11:18:36 UTC |
4ff544a | David Douard | 18 October 2019, 13:40:01 UTC | tests: delete (now useless) storage_testing.py file | 30 October 2019, 09:25:17 UTC |
2a6bf45 | David Douard | 28 October 2019, 10:57:52 UTC | conftest: make it possible to configure SQL dump files used by SwhDatabaseJanitor so one can use the postgresql_fact fixture factory for other tests than Storage ones (eg. for swh-indexer storage tests). | 30 October 2019, 09:06:57 UTC |
e2402e0 | David Douard | 29 October 2019, 09:10:52 UTC | conftest: do not use hypothesis to generate origins and contents using gen_origins and gen_contents helper functions from swh.model for the Storage under test. This is required because 1/ it was a non-conventional use of hypothesis, and 2/ since hypotesis 4.42, tests using hypothesis-generated origins and contents are broken. Also increase default origins generated size to 100. | 30 October 2019, 08:58:10 UTC |
35bdea8 | David Douard | 29 October 2019, 15:14:57 UTC | make in_memory Storage compatible with frozen model entities since attr based model entities are now frozen in swh.model 0.0.50 | 29 October 2019, 15:17:12 UTC |
28818ab | Nicolas Dandrimont | 23 October 2019, 08:46:07 UTC | Remove origin['type'] This is now superseded by origin_visit['type'] | 23 October 2019, 11:08:48 UTC |
655d2ae | Nicolas Dandrimont | 23 October 2019, 08:44:42 UTC | Add missing files to MANIFEST.in | 23 October 2019, 11:08:48 UTC |
1ab9d64 | Nicolas Dandrimont | 23 October 2019, 08:44:11 UTC | Move hypothesis strategy definitions to swh/storage/tests/conftest.py | 23 October 2019, 11:08:48 UTC |
f68f4c3 | Nicolas Dandrimont | 17 October 2019, 12:42:35 UTC | Replace unwanted data.originX['type'] in tests | 23 October 2019, 11:08:48 UTC |
578d2c6 | Nicolas Dandrimont | 23 October 2019, 08:48:55 UTC | Use a wildcard to get the list of SQL files | 23 October 2019, 11:08:48 UTC |
484cebb | Antoine R. Dumont (@ardumont) | 14 October 2019, 12:56:20 UTC | schemata: Send only origin url for scheduling debian loader task Related D2135 | 17 October 2019, 15:53:53 UTC |
9984111 | Nicolas Dandrimont | 17 October 2019, 12:23:38 UTC | Remove origin_visit_add fallback for type=None This prepares the removal of the type column from the origin table | 17 October 2019, 13:45:10 UTC |
6d98503 | Nicolas Dandrimont | 17 October 2019, 12:21:20 UTC | Always use explicit visit type in origin_visit_add | 17 October 2019, 13:44:15 UTC |
6781be1 | Nicolas Dandrimont | 17 October 2019, 12:19:30 UTC | Remove useless origin visits from snapshot-only tests | 17 October 2019, 13:44:15 UTC |
d165c09 | Nicolas Dandrimont | 17 October 2019, 11:37:43 UTC | Remove now-useless triggers | 17 October 2019, 13:44:15 UTC |
74a6437 | Antoine R. Dumont (@ardumont) | 17 October 2019, 12:45:19 UTC | requirements-test: Set pytest-postgresql dependencies version | 17 October 2019, 13:25:27 UTC |
fbdad1c | Valentin Lorentz | 17 October 2019, 12:49:39 UTC | Remove fetch_history. It is not used anymore. | 17 October 2019, 12:59:45 UTC |
1b3ff24 | Jenkins for Software Heritage | 17 October 2019, 11:52:47 UTC | Updated debian changelog for version 0.0.154 | 17 October 2019, 11:52:47 UTC |
700224a | Jenkins for Software Heritage | 17 October 2019, 11:52:46 UTC | Update upstream source from tag 'debian/upstream/0.0.154' Update to upstream version '0.0.154' with Debian dir c960d279c8e1dd8ad7d49e4a81b063dae028f0d3 | 17 October 2019, 11:52:46 UTC |
5eb74d7 | Jenkins for Software Heritage | 17 October 2019, 11:52:45 UTC | New upstream version 0.0.154 | 17 October 2019, 11:52:45 UTC |
1b8e042 | Antoine R. Dumont (@ardumont) | 17 October 2019, 11:33:47 UTC | d/control: Update build dependencies | 17 October 2019, 11:43:35 UTC |
84bcfb3 | Antoine R. Dumont (@ardumont) | 17 October 2019, 11:38:35 UTC | tests: Move sample_data fixture to swh/storage/tests/conftest.py | 17 October 2019, 11:41:46 UTC |
345f9d1 | Jenkins for Software Heritage | 17 October 2019, 11:26:13 UTC | Updated debian changelog for version 0.0.153 | 17 October 2019, 11:26:13 UTC |
c58ba04 | Jenkins for Software Heritage | 17 October 2019, 11:26:12 UTC | Update upstream source from tag 'debian/upstream/0.0.153' Update to upstream version '0.0.153' with Debian dir 80ef1c6af9ef4cd1931b74ddcca7351df6b28272 | 17 October 2019, 11:26:12 UTC |
7eef1c0 | Jenkins for Software Heritage | 17 October 2019, 11:26:11 UTC | New upstream version 0.0.153 | 17 October 2019, 11:26:11 UTC |
3bb46f6 | David Douard | 08 October 2019, 13:39:11 UTC | test_storage: kill StorageTestDbFixture class it's not used any more. | 14 October 2019, 12:32:57 UTC |
dbea02c | David Douard | 10 October 2019, 15:30:36 UTC | test_api_client: refactor the code for new pytest based infra This uses the latest pytest fixtures added in swh.core to define a swh_storage fixture that setup a RPC client/server stack to execute tests defined in classes TestStorage and TestStorageGeneratedData (from swh.storage.tests.test_storage). | 14 October 2019, 12:32:57 UTC |
8003db6 | David Douard | 10 October 2019, 15:29:35 UTC | api: add (missing) refresh_stat_counters() endpoint so we do not need special cases in tests, at least. | 14 October 2019, 12:32:57 UTC |
8a9cfeb | David Douard | 14 October 2019, 08:50:46 UTC | tests/algos: rewrite test_snapshot with pytest | 14 October 2019, 12:32:57 UTC |
cadafef | David Douard | 08 October 2019, 14:10:18 UTC | in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests This defines a local swh_storage fixture that uses an InMemoryStorage to execute tests defined in classes TestStorage and TestStorageGeneratedData (from swh.storage.tests.test_storage). Adapt tests for the InMemoryStorage to new storage test infra. | 14 October 2019, 12:32:14 UTC |
8529e7b | David Douard | 08 October 2019, 14:08:58 UTC | test_storage: rename TestStorageCommonProp as TestStorageGeneratedData somehow a bit clearer, maybe. Also adapt test_in_memory.py and test_api_client.py with this rename even if these tests are xfailed for now to prevent ImportError when running the whole test suite. | 14 October 2019, 12:14:08 UTC |
743f915 | David Douard | 08 October 2019, 14:06:58 UTC | test_storage: make test_origin_metadata_get more robust Nothing garantees us that Storage.origin_metadata_get_by() result is sorted, so don't expect it is. | 14 October 2019, 12:14:08 UTC |
204b9fa | David Douard | 08 October 2019, 13:40:03 UTC | test_storage: move db specific methods from main TestStorage to TestPgStorage which is actually TestAlteringSchema that have been renamed to be a bit more meaningful. | 14 October 2019, 12:14:08 UTC |
9f12202 | David Douard | 14 October 2019, 08:45:13 UTC | conftest: use an in memory obj storage | 14 October 2019, 12:14:08 UTC |
fb70f88 | David Douard | 30 September 2019, 10:14:47 UTC | tests: refactor main storage tests - use pytest instead of unittest.TestCase plumbing - extract data from the TestStorageData into a data `storage_data` module; this module also provide a simple helper `StorageData` class that mimics the original class (access by attributes), - implement a series of pytest fixtures for these storage specific tests, - get rid of most hypothesis-based tests, - replace usage of the use_url hypothesis boolean statetgy by pytest.mark.parametrize fixtures; this allows to prevent from the need of resetting the storage, since tests are truly executed twice (thus with a new swh_storage), - refactor test_db to use pytest-postgresql. Disable (xfail) tests from test_snapshot.py, test_api_client and test_in_memory for now. Fixes/refactorings come with following revisions. | 14 October 2019, 12:14:08 UTC |
62aff76 | Antoine R. Dumont (@ardumont) | 09 October 2019, 21:01:09 UTC | Remove indirection swh.storage.api.wsgi to start server | 09 October 2019, 21:01:09 UTC |
654a37e | Antoine R. Dumont (@ardumont) | 09 October 2019, 13:28:51 UTC | tox.ini: Fix py3 environment to use packaged tests Related D2082 | 09 October 2019, 13:28:51 UTC |
687b351 | Jenkins for Software Heritage | 08 October 2019, 15:03:16 UTC | Updated debian changelog for version 0.0.152 | 08 October 2019, 15:03:16 UTC |
0f8e9eb | Jenkins for Software Heritage | 08 October 2019, 15:03:16 UTC | Update upstream source from tag 'debian/upstream/0.0.152' Update to upstream version '0.0.152' with Debian dir 6776bb22d25d739b7969e625e20e7989fd4ea777 | 08 October 2019, 15:03:16 UTC |
3464757 | Jenkins for Software Heritage | 08 October 2019, 15:03:15 UTC | New upstream version 0.0.152 | 08 October 2019, 15:03:15 UTC |
03d5a2c | Antoine R. Dumont (@ardumont) | 08 October 2019, 12:13:14 UTC | swh.storage.buffer: Add buffering proxy storage implementation Related T1389 | 08 October 2019, 14:40:51 UTC |
c83f1f9 | Antoine R. Dumont (@ardumont) | 08 October 2019, 12:09:23 UTC | swh.storage.filter: Add filtering storage implementation Also add a sample_data fixture to read default test data from. Related T1389 | 08 October 2019, 14:12:49 UTC |
02b25f0 | Antoine R. Dumont (@ardumont) | 08 October 2019, 12:07:54 UTC | swh.storage: Test get_storage implementation | 08 October 2019, 14:09:56 UTC |
3228b18 | Nicolas Dandrimont | 02 October 2019, 15:21:07 UTC | test_storage: Use the db_transaction context manager instead of raw connections This minimizes the risk of dangling db connections, which in turn reduces the chance of cascading test failures. | 02 October 2019, 15:21:07 UTC |