swh:1:snp:eb70f1f85391e4b077c211bec36af0061c4bf937

sort by:
Revision Author Date Message Commit Date
2fd48ea d/changelog: Bump new release 07 August 2020, 21:03:31 UTC
740985e d/control: Add new deps 07 August 2020, 21:01:51 UTC
a822641 Updated debian changelog for version 0.13.1 07 August 2020, 16:23:02 UTC
8170249 Update upstream source from tag 'debian/upstream/0.13.1' Update to upstream version '0.13.1' with Debian dir c2d713f6dbcfe125cc7acb31d5b33a44fdd61e4f 07 August 2020, 16:23:00 UTC
3635528 New upstream version 0.13.1 07 August 2020, 16:22:56 UTC
4918759 Make snapshot_get_branches return a TypedDict containing SnapshotBranch objects. Instead of untyped dictionaries. This makes snapshot_get longer and duplicates its code across backends; but snapshot_get should be removed soon. Related: T645 07 August 2020, 13:51:26 UTC
6ef7a92 Updated debian changelog for version 0.13.0 07 August 2020, 10:49:28 UTC
5e10f66 Update upstream source from tag 'debian/upstream/0.13.0' Update to upstream version '0.13.0' with Debian dir 3ec0254ffee829e62706e79906b3358a9041c974 07 August 2020, 10:49:27 UTC
e27f8a5 New upstream version 0.13.0 07 August 2020, 10:49:24 UTC
d9ff391 storage*: Rename and type content_get(List[Sha1]) -> List[Optional[Content]] Related to T645 07 August 2020, 10:24:41 UTC
bfa8f46 storage*: Rename content_get_data(Sha1) -> Optional[bytes] Rename the confusing endpoint `content_get` to `content_get_data`. This now works on one content as it is how it is used today. Related to T645 07 August 2020, 10:21:36 UTC
243e873 Simplify as Content.ctime None is popped out of a to_dict call in recent model since model 0.6.6 (similarly to the data field) Fixes build [1] [1] https://jenkins.softwareheritage.org/job/DSTO/job/tests/1534/console 07 August 2020, 10:21:14 UTC
653b1f9 cassandra.storage: Use next token for pagination instead of computing it The existing implementation computed the next token using the tok (adding 1). It's not good enough as it would skip some contents in case of collision on tok (collisions exist as the tok here is a noncryptographic hash on 32 bits). Related to T2518 06 August 2020, 16:50:27 UTC
1ec875a Updated debian changelog for version 0.12.0 06 August 2020, 06:55:27 UTC
c587aa0 Update upstream source from tag 'debian/upstream/0.12.0' Update to upstream version '0.12.0' with Debian dir 012b1b76ed424f2528fe7ba53a38e65371e3a40e 06 August 2020, 06:55:26 UTC
653d7e1 New upstream version 0.12.0 06 August 2020, 06:55:22 UTC
be9e958 in_memory: Drop dead code Related to T645 05 August 2020, 18:01:20 UTC
0d72ea2 storage*: content_get_partition(...) -> PagedResult[Content] Related to T645 05 August 2020, 15:01:24 UTC
b48d834 storage*: Drop deprecated content_get_range endpoint Related to T645 05 August 2020, 13:19:59 UTC
4722663 storage*: object_find_by_sha1_git: Type remaining existing endpoints Related to T2517 05 August 2020, 11:06:58 UTC
334a016 storage*: snapshot_get_branches: Type remaining existing endpoints Related to T2517 05 August 2020, 10:47:46 UTC
27c7f07 storage*: snapshot_count_branches: Type remaining existing endpoints Related to T2517 05 August 2020, 10:35:31 UTC
ec620af storage*: snapshot_get_by_origin_visit: Type remaining existing endpoints Related to T2517 05 August 2020, 10:29:24 UTC
7c6c088 storage*: snapshot_get: Type remaining existing endpoints Related to T2517 05 August 2020, 10:23:47 UTC
ec4aed4 storage*: snapshot_missing: Type remaining existing endpoints Related to T2517 05 August 2020, 10:23:11 UTC
7dbd64d storage*: release_get: Type remaining existing endpoints Related to T2517 05 August 2020, 10:23:07 UTC
5f6630a storage*: release_missing: Type remaining existing endpoints Related to T2517 05 August 2020, 10:23:03 UTC
c5d63ad storage*: origin_get_by_sha1: Drop generator from pgstorage And simplify its type Related to T645 05 August 2020, 09:12:56 UTC
760cbf6 storage*: revision_*log: Type remaining existing endpoints Related to T645 05 August 2020, 09:12:56 UTC
38ee525 storage*: revision_get: Type remaining existing endpoints Related to T645 05 August 2020, 06:18:28 UTC
8b6d18e storage*: revision_missing: Type remaining existing endpoints Related to T645 05 August 2020, 06:11:04 UTC
9f214bc storage*: directory_entry_get_by_path: Type remaining existing endpoints Related to T645 04 August 2020, 21:04:26 UTC
f9d0952 storage*: directory_ls: Type remaining existing endpoints Related to T645 04 August 2020, 20:43:23 UTC
fd5fd86 storage*: directory_missing: Type remaining existing endpoints Related to T645 04 August 2020, 20:27:45 UTC
5d13cd7 storage*: skipped_content_missing: Type remaining existing endpoints Related to T645 04 August 2020, 20:17:00 UTC
1a2aa70 storage*: content_missing_per_sha1_git: Type remaining existing endpoints Related to T645 04 August 2020, 19:42:19 UTC
15e4863 storage*: content_missing_per_sha1: Type remaining existing endpoints Related to T645 04 August 2020, 19:41:36 UTC
b62afbb storage*: content_missing: Unify and type remaining existing endpoints This updates the docstrings as well Related to T645 04 August 2020, 16:52:00 UTC
d6f26e4 storage*: content_get_partition: Type remaining existing endpoints Related to T645 04 August 2020, 16:51:59 UTC
8644733 storage*: content_get_range: Type remaining existing endpoints Related to T645 04 August 2020, 16:51:59 UTC
c6da282 storage*: content_get: Type remaining existing endpoints Related to T645 04 August 2020, 16:51:59 UTC
25ebc48 storage*: content_update: Type remaining existing endpoints Related to T645 04 August 2020, 16:51:59 UTC
c32e224 storage*: origin_get_by_sha1: Type remaining existing endpoints Related to T645 04 August 2020, 16:39:48 UTC
26ef015 storage*: check_config: Type remaining existing endpoints Related to T645 04 August 2020, 16:00:30 UTC
1b96ace Updated debian changelog for version 0.11.10 04 August 2020, 12:15:22 UTC
9d11a4e Update upstream source from tag 'debian/upstream/0.11.10' Update to upstream version '0.11.10' with Debian dir 0682ec4aedae9d395e591d7baaf54449a576de9b 04 August 2020, 12:15:20 UTC
6ca837c New upstream version 0.11.10 04 August 2020, 12:15:16 UTC
a5232b7 tests: Improve coverage on directory_ls endpoints This fixes the current directory listing tests coverage to check down to the contents. This also fixes one inconsistent test data and the tests impacted by this change. 04 August 2020, 11:34:48 UTC
15e8c99 storage*: Type content_find(...) -> List[Content] Related to T645 04 August 2020, 09:22:45 UTC
3c2e5a3 storage*: Type {cnt,dir,rev,rel,snp}_get_random(...) -> Sha1Git Related to T645 03 August 2020, 14:23:44 UTC
44807d8 Updated debian changelog for version 0.11.9 03 August 2020, 10:02:56 UTC
37689c9 Update upstream source from tag 'debian/upstream/0.11.9' Update to upstream version '0.11.9' with Debian dir 01423f66eb2af59524c287338dc4235b9f95cf3c 03 August 2020, 10:02:55 UTC
e420486 New upstream version 0.11.9 03 August 2020, 10:02:51 UTC
aa58e10 storage*: Drop origin-get-range in favor of origin-list Related to T645 03 August 2020, 09:39:58 UTC
87c5ba2 storage*: Do not allow unknown visit status in origin_visit*_get_latest That makes some storage (pg-storage) fail without that filtering. 01 August 2020, 07:07:12 UTC
9c18381 Updated debian changelog for version 0.11.8 31 July 2020, 13:17:40 UTC
de9a56a Update upstream source from tag 'debian/upstream/0.11.8' Update to upstream version '0.11.8' with Debian dir 04155cd323a18583d6dae27f6620810e55c1e0d4 31 July 2020, 13:17:38 UTC
cce71b8 New upstream version 0.11.8 31 July 2020, 13:17:34 UTC
92f1183 storage*: Add type annotation to origin_count Related to T645 31 July 2020, 12:51:14 UTC
3466e48 Reuse swh.core stream_results function Related to T645 31 July 2020, 12:15:51 UTC
0eb309e Rename argument 'object_type' of raw_extrinsic_metadata_get to 'type'. For consistency with RawExtrinsicMetadata. 31 July 2020, 11:00:59 UTC
b385c79 Make raw_extrinsic_metadata_get return PagedResult instead of Dict. 31 July 2020, 10:56:34 UTC
df943ec pg: Rewrite _origin_query to force the query planner to filter on URLs before filtering on visits. URL filters usually have a few matches and use the index; whereas filtering on visits requires to scan the entire origin table first. This makes the query considerably faster. Credit for the idea goes to @olasd. 31 July 2020, 08:12:41 UTC
0c5a8e2 Add support for metadata-related object types to the backfiller and replayer. Existing tests automatically test them, using data from swh.journal.tests. 30 July 2020, 17:39:41 UTC
24bc51d test_replay: update for swh.journal 0.4.1. DUPLICATE_CONTENTS now contains BaseModel objects. 30 July 2020, 17:36:49 UTC
221e40c Updated debian changelog for version 0.11.6 30 July 2020, 14:29:11 UTC
c8d6673 Update upstream source from tag 'debian/upstream/0.11.6' Update to upstream version '0.11.6' with Debian dir 71a5fa5147e4c905fe8adc91fbd3ee792f62aae1 30 July 2020, 14:29:09 UTC
8608172 New upstream version 0.11.6 30 July 2020, 14:29:06 UTC
cf9f44e storage*: Type origin_search(...) -> PagedResult[Origin] Related to T645 30 July 2020, 14:24:55 UTC
4d52fc1 storage*: Adapt origin_list(...) -> PagedResult[Origin] Related to T645 30 July 2020, 12:32:20 UTC
7beba93 algos.snapshot: Open snapshot_id_get_from_revision This leverages the latest change in origin_visit_get and origin_visit_status_get to iterate over visit and visit status to detect a snapshot targetting a revision. This algo got used recently in the deposit. It may serve again. Related to T645 30 July 2020, 12:10:12 UTC
b81f928 storage*: add origin_visit_status_get(...) -> PagedResult[OriginVisitStatus] Related to T645 30 July 2020, 12:05:39 UTC
8cf6efa Add type annotations on get_storage. The main goal of this commit is to add '-> StorageInterface', so all storage users automatically get type-checked. But mypy was whining about the multiple imports, so this commit also deduplicates the import statements as a side-effect. 30 July 2020, 11:53:38 UTC
e63b78c buffer: Pass lists to backend functions, not iterables. Unbreaks swh-loader-core's tests, which are all red when run with the current swh-storage version. Unfortunately, swh-storage's tests did not catch it, because the in-memory backend works fine with iterables, but the pg backend doesn't. 30 July 2020, 09:30:28 UTC
7667f7e test_origin_visit_get_all: Use tokens as opaque values. 29 July 2020, 15:23:33 UTC
708522d test_origin_visit_get_all: Make assertions consistent. 29 July 2020, 15:23:24 UTC
2bfd2f7 storage*: Simplify next-page-token computation Related to T645 29 July 2020, 15:12:00 UTC
874646e filter: Fix types passed to the proxied storage. 29 July 2020, 14:51:51 UTC
24559bb Fix upcoming type warning with swh.core > v0.1.2. origin_visit_status_get_latest expects an int, not Optional[int]; but this error wasn't detected so far because mypy couldn't detect the type of the function. The next release of swh.core fixes that issue, so this fix is now needed to not trigger a mypy error. 29 July 2020, 14:24:11 UTC
b6202a0 Make API endpoints take Lists instead of Iterables as arguments 1. clients crash when they call the API with an iterator 2. some backend implementations violate the contract by assuming the argument is a sequence (eg. by iterating twice on it, and assuming the elements are the same) 3. no matter what we do, the endpoints will always get a list as argument in practice, because they go through the RPC framework 4. there is no concrete (ha!) advantage in taking an Iterable rather than a List. 29 July 2020, 14:24:11 UTC
21b7730 storage*: use an enum to explicit the order in origin_visit_get Related to T645 29 July 2020, 12:43:36 UTC
643ebc6 storage*: origin_visit_get(...) -> PagedResult[OriginVisit] Related to T645 29 July 2020, 12:43:36 UTC
f543bd5 Write metadata + metadata authorities/fetchers to the journal. 28 July 2020, 13:59:35 UTC
9167dc7 Updated debian changelog for version 0.11.5 28 July 2020, 08:10:21 UTC
d48adf4 Update upstream source from tag 'debian/upstream/0.11.5' Update to upstream version '0.11.5' with Debian dir a25d13a30234e582d4f2f5c2700eab3db2c2a492 28 July 2020, 08:10:20 UTC
b4cd42d New upstream version 0.11.5 28 July 2020, 08:10:17 UTC
77960ca in_memory: fix tie-breaking when two visits have the same date. swh-loader-core's tests depend on this behavior. 28 July 2020, 07:54:55 UTC
7543dc8 Updated debian changelog for version 0.11.4 27 July 2020, 14:16:18 UTC
548f018 Update upstream source from tag 'debian/upstream/0.11.4' Update to upstream version '0.11.4' with Debian dir a95acf15bcf503742e7f5ce212010932a5cc49a5 27 July 2020, 14:16:17 UTC
b64c58d New upstream version 0.11.4 27 July 2020, 14:16:13 UTC
119d01e storage*: origin_visit_get_by -> Optional[OriginVisit] Related to T645 27 July 2020, 12:44:16 UTC
2d51be9 Rename object_metadata to raw_extrinsic_metadata. For consistency with the name in swh-model. 27 July 2020, 12:18:49 UTC
57e305e storage*: origin_visit_find_by_date -> Optional[OriginVisit] Related to T645 27 July 2020, 10:46:35 UTC
b31c304 algos.origin: Simplify origin_get_latest_visit_status function 27 July 2020, 09:56:33 UTC
5344a6f storage*: type origin_visit_get_latest endpoint result The endpoint returns an optional OriginVisit object instead of a dict: ``` def origin_visit_get_latest(...) -> Optional[OriginVisit] ``` It also fixes the in-memory storage implementation which filtered data too early. It only filtered on the latest origin visit status associated to the origin visit. So depending on filters, this could have been wrong. It was not much of a problem as there is no longer any direct clients of this api (they are using [1] now). [1] swh.storage.algos.origin.origin_get_latest_origin_visit_status function Related to T645 27 July 2020, 09:56:33 UTC
6f0946d Updated debian changelog for version 0.11.3 27 July 2020, 06:08:56 UTC
2324094 Update upstream source from tag 'debian/upstream/0.11.3' Update to upstream version '0.11.3' with Debian dir b2477219c2018c32c320df9ddcf9f011f7185c12 27 July 2020, 06:08:54 UTC
65ea9e8 New upstream version 0.11.3 27 July 2020, 06:08:50 UTC
789972f metadata_{authority,fetcher}_add: Fix crash when the iterable argument is empty. 24 July 2020, 07:28:33 UTC
7e94767 storage*: origin_get(Iterable[str]) -> Iterable[Optional[Origin]] This: - drops the legacy behavior (no more input as list of dicts or even one dict). - aligns with other _get endpoints (only 1 iterable of identifiers as input, here the origin urls). - migrates towards returning an iterable of optional origin model objects (again the optional part is alignment with existing get endpoint) Related to T645 23 July 2020, 16:16:38 UTC
back to top