https://github.com/SoftwareHeritage/swh-storage

sort by:
Revision Author Date Message Commit Date
f10fa4d Updated backport on buster-swh from debian/0.0.167-1_swh1 (unstable-swh) 24 January 2020, 14:05:01 UTC
f4d3758 Merge tag 'debian/0.0.167-1_swh1' into debian/buster-swh 24 January 2020, 14:05:00 UTC
7245ee9 Updated debian changelog for version 0.0.167 24 January 2020, 14:01:58 UTC
e180f2a Update upstream source from tag 'debian/upstream/0.0.167' Update to upstream version '0.0.167' with Debian dir e797a96b300338124b09f8b75bef2996fc8220d9 24 January 2020, 14:01:57 UTC
e62d6e4 New upstream version 0.0.167 24 January 2020, 14:01:56 UTC
c8389c2 146: Fix typo 24 January 2020, 13:54:26 UTC
2ebcdf3 pgstorage: Empty temp tables instead of dropping them Due to our pattern of adding objects [1], vacuum is triggered regularly on pg_catalog.*, having an heavy impact on performance. This commit tries to avoid the dropping the temporary tables part, emptying them instead (they still are dropped at the end of the session but less often). This should decrease the bloat on pg_catalog.* tables. [1] - create temporary table - insert data from temporary table to production table with filtering - drop temporary table 24 January 2020, 11:14:00 UTC
a3acab9 Updated backport on buster-swh from debian/0.0.166-1_swh1 (unstable-swh) 24 January 2020, 09:03:23 UTC
08ad7b1 Merge tag 'debian/0.0.166-1_swh1' into debian/buster-swh 24 January 2020, 09:03:23 UTC
7db8312 Updated debian changelog for version 0.0.166 24 January 2020, 09:00:12 UTC
9da9a85 Update upstream source from tag 'debian/upstream/0.0.166' Update to upstream version '0.0.166' with Debian dir ee457449f805ebd9a5e9e10c911c8939bc4d5b4c 24 January 2020, 09:00:11 UTC
74bb123 New upstream version 0.0.166 24 January 2020, 09:00:10 UTC
cc25810 assert list doesn't have too many values 22 January 2020, 14:24:08 UTC
2ebce62 test endpoint: content_missing (sha1_git), snapshot_missing 22 January 2020, 14:24:08 UTC
c40d327 in memory changes 22 January 2020, 14:24:08 UTC
55ebd23 storage: Add endpoint to get missing content (by sha1_git) and missing snapshot 22 January 2020, 14:24:08 UTC
cfee7b5 Remove redundant config checks in load_and_check_config. 1. There is no reason to force the server to serve only the 'local' backend anymore 2. Missing arguments will error when instantiating the backend class. 22 January 2020, 11:25:24 UTC
2454a78 docs: Fix sphinx warnings Related to T2188 17 January 2020, 16:02:35 UTC
2dc17cd Remove 'id' and 'object_id' from the output of object_find_by_sha1_git. 'id' is not used anymore, and 'object_id' never was. This commit slightly simplifies existing code, and will allow some deduplication in the upcoming Cassandra backend. 17 January 2020, 14:10:56 UTC
b5a5084 Make origin_visit_get_random return None instead of {} if there are no results. This is more consistent with other endpoints. 17 January 2020, 14:10:36 UTC
dba9e04 Rewrite test_content_get_partition_empty to not assume partitions are based on sha1. This is not true of the upcoming Cassandra backend. 17 January 2020, 14:10:11 UTC
e584655 Remove test_content_*_same_input, which check for behavior we do not want to guarantee. They check that content_add deduplicates with existing content/duplicated input. This is unneeded (the loaders don't send such data), so providing these guarantees unnecessarily complicates swh-storage code, especially the upcoming Cassandra backend. 17 January 2020, 14:09:38 UTC
e07c742 Updated backport on buster-swh from debian/0.0.165-1_swh1 (unstable-swh) 17 January 2020, 13:12:48 UTC
2ebcbc9 Merge tag 'debian/0.0.165-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.165-1~swh1 # Conflicts: # debian/changelog 17 January 2020, 13:12:47 UTC
92af2cd Updated debian changelog for version 0.0.165 17 January 2020, 13:09:40 UTC
ac79988 Update upstream source from tag 'debian/upstream/0.0.165' Update to upstream version '0.0.165' with Debian dir c24845a1a2ad014144923b527940b11c269f8081 17 January 2020, 13:09:39 UTC
079fa61 New upstream version 0.0.165 17 January 2020, 13:09:38 UTC
bf77f14 storage.retry: Fix objects loading when using generator parameters This will fix related retry error [1] [1] https://sentry.softwareheritage.org/share/issue/ddbbdd3c235b40ca826bf2c820989f14/ Related to cc29708564c35575f569e863f028a480a9905cf4 Related to D2543 17 January 2020, 12:55:36 UTC
a6742ee Updated backport on buster-swh from debian/0.0.164-1_swh1 (unstable-swh) 16 January 2020, 17:08:10 UTC
72ea9d2 Merge tag 'debian/0.0.164-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.164-1~swh1 # Conflicts: # debian/changelog 16 January 2020, 17:08:09 UTC
a7cbaf1 Updated debian changelog for version 0.0.164 16 January 2020, 17:05:03 UTC
4578987 Update upstream source from tag 'debian/upstream/0.0.164' Update to upstream version '0.0.164' with Debian dir 23094cd1a4429ea115d7ffdaac67f3aea22ae353 16 January 2020, 17:05:02 UTC
4738b2e New upstream version 0.0.164 16 January 2020, 17:05:01 UTC
cc29708 storage: Fix objects loading when using generator parameters Some objects (directories, origins, releases, revisions) will not be added into the storage if they are provided as generator parameters to the *_add methods instead of lists. So ensure to transform generators into lists before processing the objects. 16 January 2020, 16:53:22 UTC
cca0dc8 Updated backport on buster-swh from debian/0.0.163-1_swh2 (unstable-swh) 14 January 2020, 16:33:32 UTC
1c6176a Merge tag 'debian/0.0.163-1_swh2' into debian/buster-swh swh-storage Debian release 0.0.163-1~swh2 # gpg: Signature made Tue Jan 14 16:29:21 2020 UTC # gpg: using RSA key BF00203D741AC9D546A8BE0752E2E9840D10C3B8 # gpg: Can't check signature: No public key # Conflicts: # debian/changelog 14 January 2020, 16:33:32 UTC
0b3610e d/changelog: Bump new release 14 January 2020, 16:27:58 UTC
8c3ef4b d/control: Add missing test dependency 14 January 2020, 16:22:48 UTC
6690419 Updated debian changelog for version 0.0.163 14 January 2020, 16:17:45 UTC
0481c44 Update upstream source from tag 'debian/upstream/0.0.163' Update to upstream version '0.0.163' with Debian dir 4ed2720d31becfe82ffadf4a9175de855e6ee5da 14 January 2020, 16:17:45 UTC
e362b9d New upstream version 0.0.163 14 January 2020, 16:17:43 UTC
b641e53 d/control: Align dependency versions with requirements.txt 14 January 2020, 16:10:13 UTC
e70f427 d/control: Add new runtime dependency 14 January 2020, 16:09:54 UTC
8dcac2b retry: Implement content_add_metadata endpoint with retry policy 14 January 2020, 12:45:11 UTC
aa588c9 retry: Migrate to tenacity Which is a maintained fork of retry 14 January 2020, 12:40:39 UTC
4aa4d79 test_retry: Improve and align consistently assertion checks 14 January 2020, 10:41:35 UTC
2b7d770 storage.retry: Implement snapshot_add with retry policy 14 January 2020, 10:41:35 UTC
df3f33f storage.retry: Implement release_add with retry policy 14 January 2020, 10:41:35 UTC
54890f7 storage.retry: Implement revision_add with retry policy 14 January 2020, 10:41:35 UTC
a8efa95 storage.retry: Implement directory_add with retry policy 14 January 2020, 10:41:34 UTC
dddb6d9 in_memory: Make directory_get_random return None when storage empty 14 January 2020, 10:41:34 UTC
2dd578c storage.retry: Implement origin_visit_update with retry policy 14 January 2020, 10:41:34 UTC
32c460c storage.retry: Implement origin_metadata_add endpoint with retry policy 14 January 2020, 10:41:34 UTC
3cf7adb storage.retry: Implement metadata_provider_add endpoint with retry policy 14 January 2020, 10:41:34 UTC
08f2f38 storage.retry: Implement tool_add endpoint with retry policy 14 January 2020, 10:41:34 UTC
fe6440e storage.retry: Implement origin_visit_add endpoint with retry policy 14 January 2020, 10:41:34 UTC
351b977 storage.retry: Implement origin_add_one endpoint with retry policy 14 January 2020, 10:41:34 UTC
024eaea content_get_metadata: Change api to return Dict[bytes, List[Dict]] Clients will be able to introspect directly from the result whether a content is known or not. 14 January 2020, 10:38:20 UTC
07b6dc3 storage.content_get_metadata: Adapt to return nothing if inexistent id is passed as input 13 January 2020, 14:18:55 UTC
4837f46 storage: Add basic proxy storage with retry policy 10 January 2020, 13:40:01 UTC
fdf2a3c Add Storage.content_get_partition endpoint, to replace content_get_range. With no guarantees on the order or how partitioning is done, and with the new-style pagination. 17 December 2019, 12:59:09 UTC
0f94312 Add endpoint 'origin_list', that will replace 'origin_get_range'. And uses the new pagination scheme, instead of origin ids. 16 December 2019, 14:17:21 UTC
a922308 Updated backport on buster-swh from debian/0.0.162-1_swh1 (unstable-swh) 16 December 2019, 13:43:57 UTC
3dcff0f Merge tag 'debian/0.0.162-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.162-1~swh1 # Conflicts: # debian/changelog 16 December 2019, 13:43:57 UTC
31a8dcf Updated debian changelog for version 0.0.162 16 December 2019, 13:41:40 UTC
931d588 Update upstream source from tag 'debian/upstream/0.0.162' Update to upstream version '0.0.162' with Debian dir b1e0a120fcce8724776bef937a3e5437289ba707 16 December 2019, 13:41:39 UTC
33925f7 New upstream version 0.0.162 16 December 2019, 13:41:38 UTC
295144f Add {content,directory,revision,release,snapshot}_get_random. Will be used to pick random objects to use them in Icinga checks. 16 December 2019, 12:38:13 UTC
fe6ac8f Move origin_visit_get_random to the right place in the code and fix its docstring. 16 December 2019, 12:37:10 UTC
31b2fc5 Deduplicate server code and move metric handling to storage.py 16 December 2019, 12:33:31 UTC
869100b Deduplicate client code. 12 December 2019, 17:26:14 UTC
38a1eff Updated backport on buster-swh from debian/0.0.161-1_swh1 (unstable-swh) 10 December 2019, 14:10:43 UTC
c5a1235 Merge tag 'debian/0.0.161-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.161-1~swh1 # Conflicts: # debian/changelog 10 December 2019, 14:10:42 UTC
21e144f Updated debian changelog for version 0.0.161 10 December 2019, 14:08:15 UTC
69c7acd Update upstream source from tag 'debian/upstream/0.0.161' Update to upstream version '0.0.161' with Debian dir 778c3c5bb55b9131271bf8de1856a3f039eba268 10 December 2019, 14:08:15 UTC
6e74f85 New upstream version 0.0.161 10 December 2019, 14:08:13 UTC
bd2a196 storage: Make origin_get_random simpler and faster 10 December 2019, 13:34:11 UTC
b440d3a storage: Prefer sample query on origin_visit The counter table is faster but may contain holes and be less up-to-date. 09 December 2019, 12:51:08 UTC
a2401b5 storage: Add endpoint to randomly pick an origin Related to T2120 09 December 2019, 12:46:13 UTC
3855b6e tox.ini: Add a py3-dev environment 09 December 2019, 12:46:13 UTC
eddde8d Updated backport on buster-swh from debian/0.0.160-1_swh1 (unstable-swh) 06 December 2019, 10:26:00 UTC
f38725c Merge tag 'debian/0.0.160-1_swh1' into debian/buster-swh swh-storage Debian release 0.0.160-1~swh1 # Conflicts: # debian/changelog 06 December 2019, 10:25:59 UTC
acea3fe Updated debian changelog for version 0.0.160 06 December 2019, 10:23:44 UTC
4069ebc Update upstream source from tag 'debian/upstream/0.0.160' Update to upstream version '0.0.160' with Debian dir e9e59c3afba4f2a3101a98a32398ba5402f4d4fc 06 December 2019, 10:23:43 UTC
0599649 New upstream version 0.0.160 06 December 2019, 10:23:42 UTC
bee73be storage.buffer: Buffer release objects as well 06 December 2019, 10:11:52 UTC
382e500 storage.tests: Unify tests sample data 06 December 2019, 10:11:25 UTC
aa65c42 Updated backport on buster-swh from debian/0.0.159-1_swh2 (unstable-swh) 26 November 2019, 16:12:45 UTC
64685dc Merge tag 'debian/0.0.159-1_swh2' into debian/buster-swh swh-storage Debian release 0.0.159-1~swh2 # gpg: Signature made Tue Nov 26 16:10:02 2019 UTC # gpg: using RSA key BF00203D741AC9D546A8BE0752E2E9840D10C3B8 # gpg: Can't check signature: No public key # Conflicts: # debian/changelog 26 November 2019, 16:12:44 UTC
0e23408 d/changelog: Bump version 26 November 2019, 16:09:38 UTC
d233974 debian/rules: Force fast hypothesis profile when running tests 26 November 2019, 14:30:05 UTC
27281e8 Makefile.local: Fix test target execution Explicitly pass tests folder as paramter when invoking pytest in order for the hypothesis profiles to be found. 26 November 2019, 14:22:36 UTC
2cac339 Implement origin lookup by sha1 Close T2045. 25 November 2019, 14:18:44 UTC
0fcb8bc Get rid of warnings about the 'args' argument to get_storage. 22 November 2019, 15:08:37 UTC
c294b73 Remove/fix wrong comments. 22 November 2019, 12:23:54 UTC
68482bb Updated debian changelog for version 0.0.159 22 November 2019, 10:10:31 UTC
1c9119c Update upstream source from tag 'debian/upstream/0.0.159' Update to upstream version '0.0.159' with Debian dir 248b0a0d38fcfc84e3f5b2af06e628a0e81ac769 22 November 2019, 10:10:30 UTC
6c99bca New upstream version 0.0.159 22 November 2019, 10:10:29 UTC
a3fd826 Migrate tox.ini to extras = xxx instead of deps = .[testing] 21 November 2019, 13:10:29 UTC
1594e25 Drop unused listener extra 21 November 2019, 13:07:08 UTC
back to top