https://github.com/SoftwareHeritage/swh-storage

sort by:
Revision Author Date Message Commit Date
687b351 Updated debian changelog for version 0.0.152 08 October 2019, 15:03:16 UTC
0f8e9eb Update upstream source from tag 'debian/upstream/0.0.152' Update to upstream version '0.0.152' with Debian dir 6776bb22d25d739b7969e625e20e7989fd4ea777 08 October 2019, 15:03:16 UTC
3464757 New upstream version 0.0.152 08 October 2019, 15:03:15 UTC
03d5a2c swh.storage.buffer: Add buffering proxy storage implementation Related T1389 08 October 2019, 14:40:51 UTC
c83f1f9 swh.storage.filter: Add filtering storage implementation Also add a sample_data fixture to read default test data from. Related T1389 08 October 2019, 14:12:49 UTC
02b25f0 swh.storage: Test get_storage implementation 08 October 2019, 14:09:56 UTC
3228b18 test_storage: Use the db_transaction context manager instead of raw connections This minimizes the risk of dangling db connections, which in turn reduces the chance of cascading test failures. 02 October 2019, 15:21:07 UTC
4c2c311 test_storage: introduce a db_transaction context manager This wraps the steps needed to get a (properly wrapped) db object and run a transaction on it so we avoid repeating ourselves 02 October 2019, 15:20:54 UTC
9bbd5e2 Postgres storage: introduce a db() context manager This helper avoids us repeating the get_db/put_db pattern all the time. 02 October 2019, 15:13:41 UTC
e8c01a2 Replace all 'inmemory' journal writers with 'memory' 02 October 2019, 15:13:41 UTC
24ea71f test_storage: Close all pool connections on teardown This avoids having a race condition between the tear down and the database removal, when using more than one connection in the pool. 02 October 2019, 15:13:41 UTC
b827ff3 Add missing build-dependency on python3-swh.journal 01 October 2019, 16:30:34 UTC
c1ce3a1 Add test triggering the race condition in content_add This minimal example triggers T2019 01 October 2019, 15:59:05 UTC
bc7882e Updated debian changelog for version 0.0.151 01 October 2019, 08:09:53 UTC
7d2c8ef Updated version 0.0.151 from 'debian/upstream/0.0.151' with Debian dir d8455d86b2bbef750d6455bdc7814ad9a28a50d5 01 October 2019, 08:09:52 UTC
f339850 New upstream version 0.0.151 01 October 2019, 08:09:52 UTC
70b15c1 api server: missing </body> 01 October 2019, 07:42:00 UTC
7c92c33 tox: anticipate mypy run to just after flake8 01 October 2019, 06:25:21 UTC
4901259 mypy.ini: be less flaky w.r.t. the packages installed in tox in particular, ignore django.* (only indirectly shipped by hypothesis) and allow unused type: ignore (on swh.journal) 01 October 2019, 06:25:21 UTC
d8fa30b storage.py: ignore typing of optional get_journal_writer import the real type is Optional[Callable[..., Any]], but redefinitions of imported stuff in try..except is currently not supported by mypy, see https://github.com/python/mypy/issues/1153 01 October 2019, 06:25:21 UTC
976aab3 mypy: ignore swh.journal to work-around dependency loop 01 October 2019, 06:25:21 UTC
ef7d2ef init.py: switch to documented way of extending path make mypy 0.730 pass cleanly again 01 October 2019, 06:25:21 UTC
395e85d typing: minimal changes to make a no-op mypy run pass 01 October 2019, 06:25:21 UTC
cbc47c4 Write objects to the journal only if they don't exist yet. * spares some bandwidth/processing time * aligns {content,directory,release,revision}_add on what {snapshot,origin}_add already does 30 September 2019, 10:05:02 UTC
e239324 Use origin URLs for skipped_content['origin'] instead of origin ids. This commit uses URLs *instead of* IDs, not in addition to. Supporting IDs should not be needed anymore. 30 September 2019, 09:43:46 UTC
0919bdf Properly mock get_journal_writer for the remote-pg-storage tests. 27 September 2019, 13:28:53 UTC
9aa6b9d journal_writer: use journal writer from swh.journal 25 September 2019, 15:00:12 UTC
be3a025 fix typos in docstrings and sample paths courtesy of codespell 21 September 2019, 19:23:01 UTC
2ceacb1 storage.origin_visit_add: Remove deprecated 'ts' parameter The parameter `date` becomes mandatory. 20 September 2019, 12:22:55 UTC
b2e8aa2 click "required" param wants bool, not int courtesy of mypy 16 September 2019, 14:57:24 UTC
ed0a8ab Updated debian changelog for version 0.0.150 04 September 2019, 14:16:10 UTC
4877168 Updated version 0.0.150 from 'debian/upstream/0.0.150' with Debian dir 5de212f89d6e2a95eb9924be907630d8cb17c1cc 04 September 2019, 14:16:09 UTC
5c7d0be New upstream version 0.0.150 04 September 2019, 14:16:08 UTC
f91671b tests/test_storage: Remove failing assertion after swh-model update 04 September 2019, 13:44:36 UTC
ddb8226 tests/test_storage: Fix tests execution with psycopg2 < 2.8 04 September 2019, 13:11:45 UTC
7901264 Updated debian changelog for version 0.0.149 03 September 2019, 12:27:51 UTC
a8b677e Updated version 0.0.149 from 'debian/upstream/0.0.149' with Debian dir 0bef94e46114c01e736cf38e0a13224530688af7 03 September 2019, 12:27:50 UTC
b00740f New upstream version 0.0.149 03 September 2019, 12:27:50 UTC
bf393fd Add support for origin_url in origin_metadata_*. 02 September 2019, 09:28:07 UTC
bc3240d Make origin_add/origin_visit_update validate their input. 29 August 2019, 11:49:48 UTC
863443b Make snapshot_add validate its input. 29 August 2019, 11:36:48 UTC
add5b01 Make revision_add and release_add validate their input. 29 August 2019, 09:34:17 UTC
6946edb Make directory_add validate its input. 29 August 2019, 09:32:54 UTC
3a6c5e3 Make content_add validate its input using swh-model. The initial goal of this commit was to make the in-mem content_add raise errors on input that would make postgresql error. As a side-effect, the pgsql content_add now validate its input as well, so clients get a nice/meaningful error instead of postgresql's error. 29 August 2019, 09:31:37 UTC
89c5af3 Updated debian changelog for version 0.0.148 23 August 2019, 08:48:21 UTC
3b98b5f Updated version 0.0.148 from 'debian/upstream/0.0.148' with Debian dir a15f5f70c8feeb8b521c9fc45e1ec3b64699fbf6 23 August 2019, 08:48:20 UTC
a4a5049 New upstream version 0.0.148 23 August 2019, 08:48:19 UTC
70f63c3 Remove 'next_branch' from test input data. It should only be in the output of 'snapshot_get_*' methods, not in the input of 'snapshot_add'. 23 August 2019, 08:31:35 UTC
54b974f Eliminate warnings about %TYPE. Using %TYPE showed this warning when tests fail for unrelated reasons: NOTICE: type reference snapshot.id%TYPE converted to sha1_git 23 August 2019, 08:26:38 UTC
b775947 Fix off-by-one error when using origin_visit_upsert on with an unknown visit id. 23 August 2019, 08:25:05 UTC
e656d6e Use explicit arguments for origin_visit_add. swh-model v0.0.42 adds more fields to OriginVisit. 22 August 2019, 12:19:00 UTC
56a031d Stop leaking person ids. They are not used anymore. 20 August 2019, 12:59:10 UTC
57f60cd Remove person_get endpoint. swh-web is about to stop using it, and was the only user of this endpoint. 20 August 2019, 12:57:24 UTC
2ef75a2 Remove test_content_missing__marked_missing, it makes no sense. status 'missing' does not exist. 19 August 2019, 12:41:38 UTC
babded5 Enforce log level for the werkzeug logger. I don't understand why it's not applied by default (since swh.core applied it to the root logger), but this commit fixes the issue. 23 July 2019, 13:09:05 UTC
f71f531 Add support for skipped content in in-memory storage 22 July 2019, 15:07:05 UTC
bc2f03c api: use RPCServerApp and RPCClient instead of deprecated classes SWHServerAPIApp and SWHRemoteAPI. Depends on swh.core 0.0.65. 18 July 2019, 11:29:07 UTC
56deea5 Updated debian changelog for version 0.0.147 18 July 2019, 10:16:16 UTC
3d6edc0 Updated version 0.0.147 from 'debian/upstream/0.0.147' with Debian dir 314a8f63a04a07082c4b0ecf41c009ec09b3e66b 18 July 2019, 10:16:16 UTC
c3c435b New upstream version 0.0.147 18 July 2019, 10:16:15 UTC
7053da8 Make origin_get ignore the `type` argument 18 July 2019, 09:38:15 UTC
74b4de4 Updated debian changelog for version 0.0.146 18 July 2019, 08:52:10 UTC
76e9def New upstream version 0.0.146 18 July 2019, 08:52:09 UTC
b01d948 Updated version 0.0.146 from 'debian/upstream/0.0.146' with Debian dir 1193d609e1da402505edb5a7147da10b73e2b3b4 18 July 2019, 08:52:09 UTC
b27fcd1 add code of conduct document 11 July 2019, 14:29:51 UTC
e102cd1 No change rebuild with proper distribution in changelog 11 July 2019, 12:03:48 UTC
8f3009b Drop useless build-dependency on swh.scheduler 11 July 2019, 11:54:12 UTC
043c57b Drop useless dependency on swh.scheduler 11 July 2019, 11:50:28 UTC
9e00284 Add tests for the in-mem storage with origin ids disabled. 10 July 2019, 14:16:18 UTC
6b68fc4 Remove the legacy behavior of snapshot_add (which updates a visit). We stopped using it a while ago by now. 08 July 2019, 12:38:47 UTC
867b3b3 Fix/silence warnings. 08 July 2019, 12:28:24 UTC
4a16a10 Add an env var to the in-mem storage to disable origin ids. If it is true (the default), there is no change from the current behavior, but setting it to False and running another package's tests allows to make sure that package does not rely on origin ids at all. 08 July 2019, 11:53:18 UTC
4303fe8 README: fix typo 04 July 2019, 12:34:22 UTC
617f602 CONTRIBUTORS: add Quentin Campos 04 July 2019, 12:34:03 UTC
79ceb21 Fix examples in the 'type' column 04 July 2019, 08:40:26 UTC
eef8cd7 Specify of extrinsic origin metadata and their storage. 03 July 2019, 14:53:25 UTC
af2d253 Make the in-memory storage use URLs instead of ids as its 'primary key' internally. This is a first step toward disabling origin-ids entirely. 03 July 2019, 08:15:41 UTC
89fc4a3 Make origin_visit_upsert take an origin dict instead of int. That's the sensible format, and the one we already use in the backfiller. 03 July 2019, 08:15:16 UTC
1516853 Updated debian changelog for version 0.0.145 02 July 2019, 10:19:19 UTC
3928adf Updated version 0.0.145 from 'debian/upstream/0.0.145' with Debian dir 5879469a1d1a7e64bfe5214c7f8cf974b04f8995 02 July 2019, 10:19:18 UTC
5715000 New upstream version 0.0.145 02 July 2019, 10:19:17 UTC
268d122 Fix rebase; reset_storage_tables was renamed to reset_storage. 01 July 2019, 16:22:37 UTC
d98f065 Make all endpoints support origin urls instead of ids. 01 July 2019, 13:52:23 UTC
f0853ac Merge id/url tests using an arg provided by hypothesis. 01 July 2019, 13:51:49 UTC
06fe23b Add an 'origin_visit_find_by_date' endpoint. It reuses the 'swh_visit_find_by_date' function that became dead code when occurences were dropped. So swh-web can use it directly instead of reimplementing its logic in 'get_origin_visit'. 01 July 2019, 13:51:20 UTC
37396a5 Add a 'reset' endpoint to the in-mem storage. It will be used for API client/server property tests, because they need to remotely reset the state and cannot create a new storage. 01 July 2019, 13:50:16 UTC
168ebf9 Add test for content_get_range's boundaries. 01 July 2019, 13:49:18 UTC
a979d22 Updated debian changelog for version 0.0.143 01 July 2019, 12:38:40 UTC
73cd3c9 Updated version 0.0.143 from 'debian/upstream/0.0.143' with Debian dir b86c8c9fe16865ade64ff63808bac2b3463c4629 01 July 2019, 12:38:39 UTC
3f4c117 New upstream version 0.0.143 01 July 2019, 12:38:38 UTC
e73e886 CONTRIBUTORS: add Ishan Bhanuka 28 June 2019, 07:42:00 UTC
96a80d2 Add support for origin_url in fetch_history_start. Unbreaks swh-loader-core. 25 June 2019, 09:58:20 UTC
4696160 Fix key names in the in-mem impl of metadata_provider_{get,add} 24 June 2019, 09:18:20 UTC
2ead4ce Added comments for all tables and columns 20 June 2019, 07:18:16 UTC
b139393 Don't use a join in origin_visit_get_latest. This changes the behavior of snapshot_get_latest, to raise an error in case a visit references an unknown snapshot. This should not happen in practice (unless we're replaying from a journal). snapshot_get_latest will be removed in the next monthes anyway. 19 June 2019, 12:34:34 UTC
dc7c1e0 Add test for snapshot/release counters. 17 June 2019, 09:00:55 UTC
aec9571 Add origin_visit counter to the in-mem storage. 17 June 2019, 09:00:55 UTC
c541224 Actually run the remote-pg-storage tests on a remote-pg. They were run on a local pg instead of via the HTTP API. 17 June 2019, 08:40:27 UTC
34c2c34 136: Drop the extra 'text' mention which fails the alter query 15 June 2019, 06:34:26 UTC
c891a5b 135: Dropping production index after new ones replacing it are built Also, the index creations must be done sequentially. Those new indexes need to be built prior to remove the old index. Otherwise, we break the api (db answering too slow leads to the api breaking). 15 June 2019, 06:34:26 UTC
back to top