https://github.com/SoftwareHeritage/swh-storage

sort by:
Revision Author Date Message Commit Date
eddde8d Updated backport on buster-swh from debian/0.0.160-1_swh1 (unstable-swh) 06 December 2019, 10:26:00 UTC
f38725c Merge tag 'debian/0.0.160-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.160-1~swh1 # Conflicts: # debian/changelog 06 December 2019, 10:25:59 UTC
acea3fe Updated debian changelog for version 0.0.160 06 December 2019, 10:23:44 UTC
4069ebc Update upstream source from tag 'debian/upstream/0.0.160' Update to upstream version '0.0.160' with Debian dir e9e59c3afba4f2a3101a98a32398ba5402f4d4fc 06 December 2019, 10:23:43 UTC
0599649 New upstream version 0.0.160 06 December 2019, 10:23:42 UTC
bee73be storage.buffer: Buffer release objects as well 06 December 2019, 10:11:52 UTC
382e500 storage.tests: Unify tests sample data 06 December 2019, 10:11:25 UTC
aa65c42 Updated backport on buster-swh from debian/0.0.159-1_swh2 (unstable-swh) 26 November 2019, 16:12:45 UTC
64685dc Merge tag 'debian/0.0.159-1_swh2' into debian/buster-swh swh-storage Debian release 0.0.159-1~swh2 # gpg: Signature made Tue Nov 26 16:10:02 2019 UTC # gpg: using RSA key BF00203D741AC9D546A8BE0752E2E9840D10C3B8 # gpg: Can't check signature: No public key # Conflicts: # debian/changelog 26 November 2019, 16:12:44 UTC
0e23408 d/changelog: Bump version 26 November 2019, 16:09:38 UTC
d233974 debian/rules: Force fast hypothesis profile when running tests 26 November 2019, 14:30:05 UTC
27281e8 Makefile.local: Fix test target execution Explicitly pass tests folder as paramter when invoking pytest in order for the hypothesis profiles to be found. 26 November 2019, 14:22:36 UTC
2cac339 Implement origin lookup by sha1 Close T2045. 25 November 2019, 14:18:44 UTC
0fcb8bc Get rid of warnings about the 'args' argument to get_storage. 22 November 2019, 15:08:37 UTC
c294b73 Remove/fix wrong comments. 22 November 2019, 12:23:54 UTC
68482bb Updated debian changelog for version 0.0.159 22 November 2019, 10:10:31 UTC
1c9119c Update upstream source from tag 'debian/upstream/0.0.159' Update to upstream version '0.0.159' with Debian dir 248b0a0d38fcfc84e3f5b2af06e628a0e81ac769 22 November 2019, 10:10:30 UTC
6c99bca New upstream version 0.0.159 22 November 2019, 10:10:29 UTC
a3fd826 Migrate tox.ini to extras = xxx instead of deps = .[testing] 21 November 2019, 13:10:29 UTC
1594e25 Drop unused listener extra 21 November 2019, 13:07:08 UTC
df4df8b Merge tox test environment configurations 21 November 2019, 13:06:55 UTC
06bd050 Deduplicate code of test_origin_get_range. 21 November 2019, 12:38:03 UTC
29eb548 Fix a few typos reported by codespell 21 November 2019, 12:16:51 UTC
bc0e81c pre-commit: explicitely whitelist 'iff' when running codespell 21 November 2019, 12:16:51 UTC
1472c8e fix trailing ws reported by pre-commit 21 November 2019, 12:16:51 UTC
264cd33 Add a pre-commit-hooks.yaml config file 21 November 2019, 12:16:51 UTC
a97db93 Fix swh-storage-add-dir to please mypy, at least. 21 November 2019, 10:19:43 UTC
c787808 Remove utils/(dump|fix)_revisions scripts these are now deprecated. 21 November 2019, 10:19:43 UTC
b337b4a Add 'pipeline' storage "class" for more readable configurations. This would allow writing configurations like: ``` storage: cls: pipeline steps: - cls: filter - cls: buffer - cls: remote url: http://swh-storage:5002/ ``` or ``` storage: cls: filter storage: cls: buffer storage: cls: remote url: http://swh-storage:5002/ ``` instead of: ``` storage: cls: filter args: storage: cls: buffer args: storage: cls: remote args: url: http://swh-storage:5002/ ``` 19 November 2019, 03:16:39 UTC
ea9aa47 and not only for an existing origin visit. This is needed in situations where the snapshot table is not in sync with the origin_visit one; typically occurs on mirrors. Also add tests for with_visit argument. 18 November 2019, 12:28:45 UTC
2bce436 Updated backport on buster-swh from debian/0.0.158-1_swh1 (unstable-swh) 14 November 2019, 12:39:30 UTC
9098e4d Merge tag 'debian/0.0.158-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.158-1~swh1 # Conflicts: # debian/changelog 14 November 2019, 12:39:30 UTC
0671131 Updated debian changelog for version 0.0.158 14 November 2019, 12:37:18 UTC
be50ce8 Update upstream source from tag 'debian/upstream/0.0.158' Update to upstream version '0.0.158' with Debian dir 9562b6097a9ae7290bfe958ec1acbf6ba4342db4 14 November 2019, 12:37:18 UTC
2a46802 New upstream version 0.0.158 14 November 2019, 12:37:16 UTC
9b4d339 d/*: Remove python3-swh.storage.schemata package The modules no longer exists Related D2272 14 November 2019, 09:54:02 UTC
e296dfb swh.storage.schemata: Drop schemata from storage As this got migrated back to the swh.lister module 14 November 2019, 09:26:41 UTC
0e7bec7 Updated backport on buster-swh from debian/0.0.157-1_swh1 (unstable-swh) 13 November 2019, 12:29:16 UTC
4e2630c Merge tag 'debian/0.0.157-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.157-1~swh1 # Conflicts: # debian/changelog 13 November 2019, 12:29:16 UTC
f2193c3 Updated debian changelog for version 0.0.157 13 November 2019, 12:27:07 UTC
07c7ce9 Update upstream source from tag 'debian/upstream/0.0.157' Update to upstream version '0.0.157' with Debian dir ca1b4e56d7d3820b3368621c3d2d187e996b6892 13 November 2019, 12:27:06 UTC
05d648e New upstream version 0.0.157 13 November 2019, 12:27:05 UTC
bb5d405 Add minimal test coverage for swh.storage.schemata 13 November 2019, 12:08:27 UTC
d788677 Fix bogus NotImplementedError on Area.index_uris This would raise when the iteration terminates even though the uris were generated. 12 November 2019, 18:08:47 UTC
94fa1bf Updated backport on buster-swh from debian/0.0.156-1_swh2 (unstable-swh) 30 October 2019, 17:30:12 UTC
186cd53 Merge tag 'debian/0.0.156-1_swh2' into debian/buster-swh swh-storage Debian release 0.0.156-1~swh2 # Conflicts: # debian/changelog 30 October 2019, 17:30:12 UTC
9908153 Add version constraint on psycopg2 30 October 2019, 17:21:42 UTC
bd6a932 Updated backport on buster-swh from debian/0.0.156-1_swh1 (unstable-swh) 30 October 2019, 17:13:43 UTC
6b5b76b Merge tag 'debian/0.0.156-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.156-1~swh1 # Conflicts: # debian/changelog 30 October 2019, 17:13:42 UTC
69a3d42 Updated debian changelog for version 0.0.156 30 October 2019, 14:29:28 UTC
a211c7b Update upstream source from tag 'debian/upstream/0.0.156' Update to upstream version '0.0.156' with Debian dir 51c2da75a276d10d50ebec212ad820f985c48dfa 30 October 2019, 14:29:27 UTC
67029e6 New upstream version 0.0.156 30 October 2019, 14:29:26 UTC
d4540ed Make visit['origin'] a string everywhere (instead of a dict). 30 October 2019, 14:08:29 UTC
0606791 Stop supporting origin ids in API (except in origin_get_range). 30 October 2019, 13:13:40 UTC
6f2e27c Updated debian changelog for version 0.0.155 30 October 2019, 11:18:37 UTC
5072307 Update upstream source from tag 'debian/upstream/0.0.155' Update to upstream version '0.0.155' with Debian dir bba9f7b007530ff59ad1370a5c630025c5b820a3 30 October 2019, 11:18:37 UTC
9064867 New upstream version 0.0.155 30 October 2019, 11:18:36 UTC
4ff544a tests: delete (now useless) storage_testing.py file 30 October 2019, 09:25:17 UTC
2a6bf45 conftest: make it possible to configure SQL dump files used by SwhDatabaseJanitor so one can use the postgresql_fact fixture factory for other tests than Storage ones (eg. for swh-indexer storage tests). 30 October 2019, 09:06:57 UTC
e2402e0 conftest: do not use hypothesis to generate origins and contents using gen_origins and gen_contents helper functions from swh.model for the Storage under test. This is required because 1/ it was a non-conventional use of hypothesis, and 2/ since hypotesis 4.42, tests using hypothesis-generated origins and contents are broken. Also increase default origins generated size to 100. 30 October 2019, 08:58:10 UTC
35bdea8 make in_memory Storage compatible with frozen model entities since attr based model entities are now frozen in swh.model 0.0.50 29 October 2019, 15:17:12 UTC
28818ab Remove origin['type'] This is now superseded by origin_visit['type'] 23 October 2019, 11:08:48 UTC
655d2ae Add missing files to MANIFEST.in 23 October 2019, 11:08:48 UTC
1ab9d64 Move hypothesis strategy definitions to swh/storage/tests/conftest.py 23 October 2019, 11:08:48 UTC
f68f4c3 Replace unwanted data.originX['type'] in tests 23 October 2019, 11:08:48 UTC
578d2c6 Use a wildcard to get the list of SQL files 23 October 2019, 11:08:48 UTC
484cebb schemata: Send only origin url for scheduling debian loader task Related D2135 17 October 2019, 15:53:53 UTC
9984111 Remove origin_visit_add fallback for type=None This prepares the removal of the type column from the origin table 17 October 2019, 13:45:10 UTC
6d98503 Always use explicit visit type in origin_visit_add 17 October 2019, 13:44:15 UTC
6781be1 Remove useless origin visits from snapshot-only tests 17 October 2019, 13:44:15 UTC
d165c09 Remove now-useless triggers 17 October 2019, 13:44:15 UTC
74a6437 requirements-test: Set pytest-postgresql dependencies version 17 October 2019, 13:25:27 UTC
fbdad1c Remove fetch_history. It is not used anymore. 17 October 2019, 12:59:45 UTC
1b3ff24 Updated debian changelog for version 0.0.154 17 October 2019, 11:52:47 UTC
700224a Update upstream source from tag 'debian/upstream/0.0.154' Update to upstream version '0.0.154' with Debian dir c960d279c8e1dd8ad7d49e4a81b063dae028f0d3 17 October 2019, 11:52:46 UTC
5eb74d7 New upstream version 0.0.154 17 October 2019, 11:52:45 UTC
1b8e042 d/control: Update build dependencies 17 October 2019, 11:43:35 UTC
84bcfb3 tests: Move sample_data fixture to swh/storage/tests/conftest.py 17 October 2019, 11:41:46 UTC
345f9d1 Updated debian changelog for version 0.0.153 17 October 2019, 11:26:13 UTC
c58ba04 Update upstream source from tag 'debian/upstream/0.0.153' Update to upstream version '0.0.153' with Debian dir 80ef1c6af9ef4cd1931b74ddcca7351df6b28272 17 October 2019, 11:26:12 UTC
7eef1c0 New upstream version 0.0.153 17 October 2019, 11:26:11 UTC
3bb46f6 test_storage: kill StorageTestDbFixture class it's not used any more. 14 October 2019, 12:32:57 UTC
dbea02c test_api_client: refactor the code for new pytest based infra This uses the latest pytest fixtures added in swh.core to define a swh_storage fixture that setup a RPC client/server stack to execute tests defined in classes TestStorage and TestStorageGeneratedData (from swh.storage.tests.test_storage). 14 October 2019, 12:32:57 UTC
8003db6 api: add (missing) refresh_stat_counters() endpoint so we do not need special cases in tests, at least. 14 October 2019, 12:32:57 UTC
8a9cfeb tests/algos: rewrite test_snapshot with pytest 14 October 2019, 12:32:57 UTC
cadafef in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests This defines a local swh_storage fixture that uses an InMemoryStorage to execute tests defined in classes TestStorage and TestStorageGeneratedData (from swh.storage.tests.test_storage). Adapt tests for the InMemoryStorage to new storage test infra. 14 October 2019, 12:32:14 UTC
8529e7b test_storage: rename TestStorageCommonProp as TestStorageGeneratedData somehow a bit clearer, maybe. Also adapt test_in_memory.py and test_api_client.py with this rename even if these tests are xfailed for now to prevent ImportError when running the whole test suite. 14 October 2019, 12:14:08 UTC
743f915 test_storage: make test_origin_metadata_get more robust Nothing garantees us that Storage.origin_metadata_get_by() result is sorted, so don't expect it is. 14 October 2019, 12:14:08 UTC
204b9fa test_storage: move db specific methods from main TestStorage to TestPgStorage which is actually TestAlteringSchema that have been renamed to be a bit more meaningful. 14 October 2019, 12:14:08 UTC
9f12202 conftest: use an in memory obj storage 14 October 2019, 12:14:08 UTC
fb70f88 tests: refactor main storage tests - use pytest instead of unittest.TestCase plumbing - extract data from the TestStorageData into a data `storage_data` module; this module also provide a simple helper `StorageData` class that mimics the original class (access by attributes), - implement a series of pytest fixtures for these storage specific tests, - get rid of most hypothesis-based tests, - replace usage of the use_url hypothesis boolean statetgy by pytest.mark.parametrize fixtures; this allows to prevent from the need of resetting the storage, since tests are truly executed twice (thus with a new swh_storage), - refactor test_db to use pytest-postgresql. Disable (xfail) tests from test_snapshot.py, test_api_client and test_in_memory for now. Fixes/refactorings come with following revisions. 14 October 2019, 12:14:08 UTC
62aff76 Remove indirection swh.storage.api.wsgi to start server 09 October 2019, 21:01:09 UTC
654a37e tox.ini: Fix py3 environment to use packaged tests Related D2082 09 October 2019, 13:28:51 UTC
687b351 Updated debian changelog for version 0.0.152 08 October 2019, 15:03:16 UTC
0f8e9eb Update upstream source from tag 'debian/upstream/0.0.152' Update to upstream version '0.0.152' with Debian dir 6776bb22d25d739b7969e625e20e7989fd4ea777 08 October 2019, 15:03:16 UTC
3464757 New upstream version 0.0.152 08 October 2019, 15:03:15 UTC
03d5a2c swh.storage.buffer: Add buffering proxy storage implementation Related T1389 08 October 2019, 14:40:51 UTC
c83f1f9 swh.storage.filter: Add filtering storage implementation Also add a sample_data fixture to read default test data from. Related T1389 08 October 2019, 14:12:49 UTC
02b25f0 swh.storage: Test get_storage implementation 08 October 2019, 14:09:56 UTC
3228b18 test_storage: Use the db_transaction context manager instead of raw connections This minimizes the risk of dangling db connections, which in turn reduces the chance of cascading test failures. 02 October 2019, 15:21:07 UTC
back to top