107e2b7 | Jenkins for Software Heritage | 28 May 2020, 12:42:14 UTC | Updated backport on buster-swh from debian/0.0.193-1_swh1 (unstable-swh) | 28 May 2020, 12:42:14 UTC |
e59f1a7 | Jenkins for Software Heritage | 28 May 2020, 12:42:14 UTC | Merge tag 'debian/0.0.193-1_swh1' into debian/buster-swh | 28 May 2020, 12:42:14 UTC |
d39c55f | Jenkins for Software Heritage | 28 May 2020, 12:37:58 UTC | Updated debian changelog for version 0.0.193 | 28 May 2020, 12:37:58 UTC |
79b686f | Jenkins for Software Heritage | 28 May 2020, 12:37:57 UTC | Update upstream source from tag 'debian/upstream/0.0.193' Update to upstream version '0.0.193' with Debian dir 9983b90d222aedc6e3a45d694c9d8dcb2ae4d6cd | 28 May 2020, 12:37:57 UTC |
14b3019 | Jenkins for Software Heritage | 28 May 2020, 12:37:55 UTC | New upstream version 0.0.193 | 28 May 2020, 12:37:55 UTC |
2209d31 | Antoine R. Dumont (@ardumont) | 27 May 2020, 11:41:28 UTC | README: Update necessary dependencies for test purposes This also adds a mention on how to avoid running the cassandra tests. | 28 May 2020, 12:25:31 UTC |
7cb3694 | Antoine R. Dumont (@ardumont) | 28 May 2020, 12:07:04 UTC | 152: Fix typo | 28 May 2020, 12:07:04 UTC |
738d648 | Antoine R. Dumont (@ardumont) | 28 May 2020, 11:32:16 UTC | db: Use query_params instead of mogrify Related to D3180 | 28 May 2020, 11:32:16 UTC |
cada7fc | Antoine R. Dumont (@ardumont) | 27 May 2020, 12:11:22 UTC | pg: Write origin visit updates & status, read from origin_visit_status That still writes new origin visit and origin visit status but reads from origin visit status. This partially reverts commit b0b767b91ca077a14368eaac1f98120261d7460c [1] [1] Related to D3101 | 28 May 2020, 11:08:10 UTC |
fe877ce | Valentin Lorentz | 28 May 2020, 09:14:10 UTC | Make content.blake2s256 not null. There is no reason to allow null anymore; and the production DB doesn't have any. | 28 May 2020, 09:14:10 UTC |
b0bff97 | Valentin Lorentz | 28 May 2020, 08:41:32 UTC | Remove unused SQL functions. | 28 May 2020, 08:50:15 UTC |
1aff3c6 | Valentin Lorentz | 28 May 2020, 08:21:35 UTC | Add a pre-commit hook to check there are version bumps in sql/upgrades/*.sql | 28 May 2020, 08:21:50 UTC |
3613438 | Valentin Lorentz | 28 May 2020, 07:54:12 UTC | Add missing dbversion bump in 150.sql. | 28 May 2020, 07:54:12 UTC |
213f1b1 | Valentin Lorentz | 14 May 2020, 12:50:46 UTC | Add artifact metadata to the extrinsic metadata storage specification. | 26 May 2020, 11:01:52 UTC |
f1b51a7 | Antoine R. Dumont (@ardumont) | 19 May 2020, 20:29:14 UTC | Add not null constraints to metadata_authority/origin_metadata Out of 149, I understood we wanted to make not null constraints on the following tables, so here it goes. This commits fixes that, migrating first the data not respecting those constraints. Related to D2988 Related to T2075 | 20 May 2020, 10:08:45 UTC |
c69d100 | Antoine R. Dumont (@ardumont) | 19 May 2020, 18:01:33 UTC | Realign schema with latest 149 migration script If we really want to make those not null, please let's make another migration script. | 19 May 2020, 19:59:24 UTC |
8ed0fde | Jenkins for Software Heritage | 19 May 2020, 16:58:29 UTC | Updated backport on buster-swh from debian/0.0.192-1_swh1 (unstable-swh) | 19 May 2020, 16:58:29 UTC |
f2b60a6 | Jenkins for Software Heritage | 19 May 2020, 16:58:29 UTC | Merge tag 'debian/0.0.192-1_swh1' into debian/buster-swh | 19 May 2020, 16:58:29 UTC |
d240458 | Jenkins for Software Heritage | 19 May 2020, 16:54:00 UTC | Updated debian changelog for version 0.0.192 | 19 May 2020, 16:54:00 UTC |
46e8506 | Jenkins for Software Heritage | 19 May 2020, 16:53:59 UTC | Update upstream source from tag 'debian/upstream/0.0.192' Update to upstream version '0.0.192' with Debian dir de8ef24fd1c59087792d6b671fbef01bf9d69216 | 19 May 2020, 16:53:59 UTC |
1523dbc | Jenkins for Software Heritage | 19 May 2020, 16:53:57 UTC | New upstream version 0.0.192 | 19 May 2020, 16:53:57 UTC |
8c2ee70 | Valentin Lorentz | 19 May 2020, 16:24:21 UTC | origin_metadata_add: Reject non-bytes types for 'metadata'. The left-over jsonize() allowed passing a dict under some circumstances, which allowed tests to pass but failed in production. | 19 May 2020, 16:29:24 UTC |
383128a | Jenkins for Software Heritage | 19 May 2020, 11:56:40 UTC | Updated backport on buster-swh from debian/0.0.191-1_swh1 (unstable-swh) | 19 May 2020, 11:56:40 UTC |
150b957 | Jenkins for Software Heritage | 19 May 2020, 11:56:40 UTC | Merge tag 'debian/0.0.191-1_swh1' into debian/buster-swh | 19 May 2020, 11:56:40 UTC |
e74fc42 | Jenkins for Software Heritage | 19 May 2020, 11:52:01 UTC | Updated debian changelog for version 0.0.191 | 19 May 2020, 11:52:01 UTC |
ddc54d7 | Jenkins for Software Heritage | 19 May 2020, 11:52:00 UTC | Update upstream source from tag 'debian/upstream/0.0.191' Update to upstream version '0.0.191' with Debian dir 4cea5d2fec1933eeeaf0a6b6c11cdb15201f3a44 | 19 May 2020, 11:52:00 UTC |
0671780 | Jenkins for Software Heritage | 19 May 2020, 11:51:58 UTC | New upstream version 0.0.191 | 19 May 2020, 11:51:58 UTC |
e645e63 | Valentin Lorentz | 09 April 2020, 09:46:21 UTC | Implement extrinsic origin metadata specification. https://docs.softwareheritage.org/devel/swh-storage/extrinsic-metadata-specification.html | 18 May 2020, 16:26:06 UTC |
60fca42 | Jenkins for Software Heritage | 18 May 2020, 12:22:58 UTC | Updated backport on buster-swh from debian/0.0.190-1_swh1 (unstable-swh) | 18 May 2020, 12:22:58 UTC |
d7347dc | Jenkins for Software Heritage | 18 May 2020, 12:22:57 UTC | Merge tag 'debian/0.0.190-1_swh1' into debian/buster-swh | 18 May 2020, 12:22:57 UTC |
00b50cb | Jenkins for Software Heritage | 18 May 2020, 12:18:10 UTC | Updated debian changelog for version 0.0.190 | 18 May 2020, 12:18:10 UTC |
e8713ec | Jenkins for Software Heritage | 18 May 2020, 12:18:09 UTC | Update upstream source from tag 'debian/upstream/0.0.190' Update to upstream version '0.0.190' with Debian dir 59f1769d77bb59afe16d2f65ad2bfae72fcc4e40 | 18 May 2020, 12:18:09 UTC |
08f99ed | Jenkins for Software Heritage | 18 May 2020, 12:18:07 UTC | New upstream version 0.0.190 | 18 May 2020, 12:18:07 UTC |
6d24ed7 | Antoine R. Dumont (@ardumont) | 18 May 2020, 11:34:45 UTC | storage: metadata_provider: Ensure idempotency when creating provider Currently, in production, we have duplicated entries in origin_metadata and metadata_provider. This is due to a bad primary key on metadata_provider. This commit ensures uniqueness when adding new metadata_provider by adding a new unique primary key on (provider_type, provider_url). This is preparatory work to allow a smooth transition for D2988 (which will need to be rebased). Related to T2075 | 18 May 2020, 11:41:05 UTC |
87f7bee | David Douard | 07 April 2020, 14:20:35 UTC | journal: add a skipped_content topic dedicated to SkippedContent objects instead of mixing them with Content in the content topic. | 13 May 2020, 10:12:41 UTC |
306aa69 | David Douard | 11 May 2020, 13:18:05 UTC | Add missing return annotations on JournalWriter methods | 11 May 2020, 14:25:22 UTC |
b04cb8f | David Douard | 11 May 2020, 09:20:38 UTC | Improve a bit the exception message of JournalWriter.content_update | 11 May 2020, 14:25:22 UTC |
46f9a7a | David Douard | 11 May 2020, 09:17:05 UTC | Refactor the JournalWriter class to normalize its methods make all the add_xxx methods take an Iterable as argument. Also extract the conditional execution of the underlying journal method calls in a dedicated methof to prevent repeating the ``if self.journal`` all over the place. Ensure all the storage code that uses this JournalWriter class are updated accordingly. | 11 May 2020, 14:25:20 UTC |
e64944b | David Douard | 11 May 2020, 14:15:51 UTC | tests: fix test_replay; do only use aware datetime objects naive dates being now properly forbidden. | 11 May 2020, 14:21:29 UTC |
4edf9e1 | Antoine R. Dumont (@ardumont) | 07 May 2020, 13:53:25 UTC | test_kafka_writer: Add missing object type skipped_content | 07 May 2020, 14:56:08 UTC |
8412d49 | Stefano Zacchiroli | 07 May 2020, 14:53:54 UTC | swh-schema.sql: improve comments on revision columns Reviewers: #reviewers, vlorentz, ardumont Reviewed By: #reviewers, vlorentz, ardumont Subscribers: ardumont, vlorentz Differential Revision: https://forge.softwareheritage.org/D2825 | 07 May 2020, 14:54:24 UTC |
74cffb7 | Stefano Zacchiroli | 07 May 2020, 14:53:54 UTC | swh-schema.sql: improve comments on revision columns Reviewers: #reviewers, vlorentz, ardumont Reviewed By: #reviewers, vlorentz, ardumont Subscribers: ardumont, vlorentz Differential Revision: https://forge.softwareheritage.org/D2825 | 07 May 2020, 14:53:54 UTC |
68eb6b3 | David Douard | 07 May 2020, 07:36:32 UTC | Update test_kafka_writer for swh.journal 0.1.0 | 07 May 2020, 08:26:24 UTC |
1443fc5 | Jenkins for Software Heritage | 04 May 2020, 16:19:47 UTC | Updated backport on buster-swh from debian/0.0.189-1_swh1 (unstable-swh) | 04 May 2020, 16:19:47 UTC |
c7d97ae | Jenkins for Software Heritage | 04 May 2020, 16:19:47 UTC | Merge tag 'debian/0.0.189-1_swh1' into debian/buster-swh | 04 May 2020, 16:19:47 UTC |
e07d234 | Jenkins for Software Heritage | 04 May 2020, 11:22:30 UTC | Updated backport on buster-swh from debian/0.0.188-1_swh1 (unstable-swh) | 04 May 2020, 11:22:30 UTC |
83e5eb6 | Jenkins for Software Heritage | 04 May 2020, 11:22:29 UTC | Merge tag 'debian/0.0.188-1_swh1' into debian/buster-swh | 04 May 2020, 11:22:29 UTC |
7d9bbfe | Jenkins for Software Heritage | 30 April 2020, 12:58:57 UTC | Updated debian changelog for version 0.0.189 | 30 April 2020, 12:58:57 UTC |
94b6946 | Jenkins for Software Heritage | 30 April 2020, 12:58:56 UTC | Update upstream source from tag 'debian/upstream/0.0.189' Update to upstream version '0.0.189' with Debian dir c15d9ed71a3944e12dd13ce35b89362c2e731d92 | 30 April 2020, 12:58:56 UTC |
b579670 | Jenkins for Software Heritage | 30 April 2020, 12:58:55 UTC | New upstream version 0.0.189 | 30 April 2020, 12:58:55 UTC |
b0b767b | Antoine R. Dumont (@ardumont) | 30 April 2020, 11:20:08 UTC | pg: Write both origin visit updates & status, read from origin_visit This partially reverts commit [1]. That now (still) writes new origin visit status... But, as before [1]: - update origin visit (with same values as origin visit status) - read from origin visit That does not revert the new in-memory (D2937) nor the cassandra (D2939) storage implementations. [1] a720caed6eebbb68a9f9b5be554a52859aa052d6 D2938 Related to D2938 Related to T2310#44043 | 30 April 2020, 11:52:13 UTC |
0e8234f | Antoine R. Dumont (@ardumont) | 29 April 2020, 10:10:17 UTC | pg-storage: Add new created state Related to T2310 | 30 April 2020, 11:43:05 UTC |
2b95dd3 | Stefano Zacchiroli | 29 April 2020, 16:33:40 UTC | setup.py: add documentation link | 29 April 2020, 16:33:40 UTC |
4dc2eb6 | Valentin Lorentz | 29 April 2020, 15:02:50 UTC | metadata spec: Fix title hierarchy | 29 April 2020, 15:02:50 UTC |
707f647 | Valentin Lorentz | 29 April 2020, 11:03:15 UTC | tests: Use aware datetimes instead of naive ones. Production should only use aware datetimes. | 29 April 2020, 11:03:15 UTC |
e3e76c4 | Antoine R. Dumont (@ardumont) | 30 March 2020, 11:08:32 UTC | cassandra: Adapt internal implementations to use origin visit update Related to T2310 | 28 April 2020, 14:46:47 UTC |
a720cae | Antoine R. Dumont (@ardumont) | 26 March 2020, 13:15:17 UTC | pg-storage: Adapt internal implementations to use origin visit update Related to T2310 | 28 April 2020, 14:46:46 UTC |
ead8088 | Antoine R. Dumont (@ardumont) | 25 March 2020, 16:53:48 UTC | in_memory: Adapt internal implementations to use origin visit update (pairing with @vlorentz) Related to T2310 | 28 April 2020, 14:46:43 UTC |
baa127e | Jenkins for Software Heritage | 28 April 2020, 11:52:09 UTC | Updated debian changelog for version 0.0.188 | 28 April 2020, 11:52:09 UTC |
03ad3ba | Jenkins for Software Heritage | 28 April 2020, 11:52:08 UTC | Update upstream source from tag 'debian/upstream/0.0.188' Update to upstream version '0.0.188' with Debian dir 50f1d39b3b3add4e066e19f2a7225c144133f3af | 28 April 2020, 11:52:08 UTC |
ff8b4ac | Jenkins for Software Heritage | 28 April 2020, 11:52:06 UTC | New upstream version 0.0.188 | 28 April 2020, 11:52:06 UTC |
49109d1 | Antoine R. Dumont (@ardumont) | 24 April 2020, 10:22:29 UTC | test_retry: Centralize time.sleep setup within a fixture This monkeypatches the internal sleep function used to not wait. This kept the previous behavior. It changes the implementation to monkeypatch though. This also centralizes within a fixture. This avoids repeating setup. The previous implementation cluttered the tests body instruction with internal implementation details. | 27 April 2020, 13:10:05 UTC |
ecadd53 | David Douard | 24 April 2020, 13:16:06 UTC | Remove recently added test_cli.test_rpc_serve* tests these are unreliable and werkzeug's tests WSGI server does not handle being executed from pytest very well (means it executes pytest all over again). | 24 April 2020, 13:16:06 UTC |
038c30b | David Douard | 22 April 2020, 15:00:45 UTC | Adapt journal client loading to swh.journal 0.0.31 | 24 April 2020, 09:58:02 UTC |
4b7ba1f | David Douard | 09 April 2020, 15:45:55 UTC | Copy the graph replayer component from swh-journal The CLI command is included as well as `swh storage replay`. Copied test test_replay, in test_cli.py, should be identical. | 24 April 2020, 09:58:02 UTC |
5fd9b56 | David Douard | 23 April 2020, 13:27:28 UTC | Deprecate the `config-path` argument of the `swh storage rpc-serve` command in favor of the standard `--config-file` option of `swh storage`. Attempt to write a couple of tests for the rpc-serve command. | 24 April 2020, 09:27:07 UTC |
cd32cf4 | David Douard | 22 April 2020, 14:57:07 UTC | Normalize the configuration file handling in the `swh storage` CLI command Almost every other swh package handles the loading of the config file from the main click command group of the package. So we make storage behaves the same. | 23 April 2020, 11:31:25 UTC |
698af8c | David Douard | 10 April 2020, 09:03:21 UTC | cli: rename the command 'backfiller' as 'backfill' for the sake of consistency. | 23 April 2020, 11:31:25 UTC |
b2bba45 | David Douard | 09 April 2020, 14:56:44 UTC | Copy the backfiller component from swh-journal This componant makes more sense in the swh-storage package. | 23 April 2020, 11:31:25 UTC |
fe56005 | Valentin Lorentz | 24 March 2020, 16:22:09 UTC | Add a wrapper to manage a sorted list. For now this is only used by sorted_sha1, but we'll need it for origin_metadata soon. | 23 April 2020, 11:03:28 UTC |
bca643a | Antoine R. Dumont (@ardumont) | 20 April 2020, 15:21:56 UTC | setup: Update the minimum required runtime python3 version Related to T2367 | 20 April 2020, 15:22:45 UTC |
32b3e93 | Stefano Zacchiroli | 17 April 2020, 14:28:18 UTC | doc: reference SWHID using explicit anchors | 17 April 2020, 14:28:18 UTC |
2145a62 | Jenkins for Software Heritage | 14 April 2020, 16:27:28 UTC | Updated backport on buster-swh from debian/0.0.187-1_swh1 (unstable-swh) | 14 April 2020, 16:27:28 UTC |
04ddb96 | Jenkins for Software Heritage | 14 April 2020, 16:27:28 UTC | Merge tag 'debian/0.0.187-1_swh1' into debian/buster-swh | 14 April 2020, 16:27:28 UTC |
b3d2bdd | Jenkins for Software Heritage | 14 April 2020, 16:23:41 UTC | Updated debian changelog for version 0.0.187 | 14 April 2020, 16:23:41 UTC |
c4baf78 | Jenkins for Software Heritage | 14 April 2020, 16:23:41 UTC | Update upstream source from tag 'debian/upstream/0.0.187' Update to upstream version '0.0.187' with Debian dir 4b30ccf98194f4e90f8cf0db487d47e7baadc998 | 14 April 2020, 16:23:41 UTC |
caa9759 | Jenkins for Software Heritage | 14 April 2020, 16:23:40 UTC | New upstream version 0.0.187 | 14 April 2020, 16:23:40 UTC |
f66184d | Antoine R. Dumont (@ardumont) | 14 April 2020, 16:05:03 UTC | storage.interface: Actually define the remote flush operation As all storage are chained together, we need to define it. We really need the actual backends, which should be the last storage chained to do noop when that endpoint is called (and they do). | 14 April 2020, 16:05:03 UTC |
baed34a | Jenkins for Software Heritage | 14 April 2020, 15:24:58 UTC | Updated backport on buster-swh from debian/0.0.186-1_swh1 (unstable-swh) | 14 April 2020, 15:24:58 UTC |
f8cd793 | Jenkins for Software Heritage | 14 April 2020, 15:24:57 UTC | Merge tag 'debian/0.0.186-1_swh1' into debian/buster-swh | 14 April 2020, 15:24:57 UTC |
121d986 | Jenkins for Software Heritage | 14 April 2020, 15:20:57 UTC | Updated debian changelog for version 0.0.186 | 14 April 2020, 15:20:57 UTC |
d078445 | Jenkins for Software Heritage | 14 April 2020, 15:20:56 UTC | Update upstream source from tag 'debian/upstream/0.0.186' Update to upstream version '0.0.186' with Debian dir ce528779d1106f75b6d5fecc36e9ff3475778afe | 14 April 2020, 15:20:56 UTC |
9a150ac | Jenkins for Software Heritage | 14 April 2020, 15:20:54 UTC | New upstream version 0.0.186 | 14 April 2020, 15:20:54 UTC |
4359874 | Nicolas Dandrimont | 14 April 2020, 14:26:18 UTC | Drop BWCompatInMemoryJournalWriter (released with swh.journal 0.0.30) | 14 April 2020, 14:26:18 UTC |
a83531d | Jenkins for Software Heritage | 14 April 2020, 12:26:08 UTC | Updated backport on buster-swh from debian/0.0.185-1_swh1 (unstable-swh) | 14 April 2020, 12:26:08 UTC |
5f28bcf | Jenkins for Software Heritage | 14 April 2020, 12:26:08 UTC | Merge tag 'debian/0.0.185-1_swh1' into debian/buster-swh | 14 April 2020, 12:26:08 UTC |
3a7456a | Jenkins for Software Heritage | 14 April 2020, 12:22:07 UTC | Updated debian changelog for version 0.0.185 | 14 April 2020, 12:22:07 UTC |
bd6204a | Jenkins for Software Heritage | 14 April 2020, 12:22:06 UTC | Update upstream source from tag 'debian/upstream/0.0.185' Update to upstream version '0.0.185' with Debian dir 9850406eeba0db1a0f770d855a6911e04448c2bc | 14 April 2020, 12:22:06 UTC |
9cf1d67 | Jenkins for Software Heritage | 14 April 2020, 12:22:04 UTC | New upstream version 0.0.185 | 14 April 2020, 12:22:04 UTC |
2cc263d | David Douard | 07 April 2020, 14:17:39 UTC | test: update storage tests to (future) swh.journal 0.0.30 which will handle swh.model objects everywhere instead of dicts. Also add a BW compat version os the InMemoryJournalWriter so tests will pass with current version of swh.journal (0.0.29). | 14 April 2020, 09:37:31 UTC |
e5e5943 | Antoine R. Dumont (@ardumont) | 14 April 2020, 08:54:14 UTC | storage.filter: Remove internal state | 14 April 2020, 08:54:14 UTC |
39d825e | Jenkins for Software Heritage | 10 April 2020, 14:18:16 UTC | Updated backport on buster-swh from debian/0.0.184-1_swh1 (unstable-swh) | 10 April 2020, 14:18:16 UTC |
2a7ac56 | Jenkins for Software Heritage | 10 April 2020, 14:18:16 UTC | Merge tag 'debian/0.0.184-1_swh1' into debian/buster-swh | 10 April 2020, 14:18:16 UTC |
eefa2e9 | Jenkins for Software Heritage | 10 April 2020, 14:14:20 UTC | Updated debian changelog for version 0.0.184 | 10 April 2020, 14:14:20 UTC |
5458209 | Jenkins for Software Heritage | 10 April 2020, 14:14:19 UTC | Update upstream source from tag 'debian/upstream/0.0.184' Update to upstream version '0.0.184' with Debian dir 762cbea3c94234f7762ade30c913f9f8b5e5e537 | 10 April 2020, 14:14:19 UTC |
0e5731c | Jenkins for Software Heritage | 10 April 2020, 14:14:17 UTC | New upstream version 0.0.184 | 10 April 2020, 14:14:17 UTC |
ddac3d2 | Antoine R. Dumont (@ardumont) | 10 April 2020, 09:40:39 UTC | test_retry: Add missing skipped_content_add tests | 10 April 2020, 11:53:34 UTC |
54b2907 | Antoine R. Dumont (@ardumont) | 08 April 2020, 13:27:08 UTC | storage*: Add flush endpoints to storage implems (backend, proxy) All storage defines one endpoint even if it's mostly noop. This avoids introspection surprises. Related to D2966 (to be consistent) | 10 April 2020, 09:08:05 UTC |
9380812 | Jenkins for Software Heritage | 09 April 2020, 10:50:21 UTC | Updated backport on buster-swh from debian/0.0.183-1_swh1 (unstable-swh) | 09 April 2020, 10:50:21 UTC |
9723f6f | Jenkins for Software Heritage | 09 April 2020, 10:50:20 UTC | Merge tag 'debian/0.0.183-1_swh1' into debian/buster-swh | 09 April 2020, 10:50:20 UTC |