6005edc | Jenkins for Software Heritage | 28 March 2019, 16:34:06 UTC | New upstream version 0.0.131 | 28 March 2019, 16:34:06 UTC |
742dd4f | Valentin Lorentz | 28 March 2019, 12:28:16 UTC | Split Storage.snapshot_add (add the snapshot + update the origin_visit) `snapshot_add(origin, visit, snap)` becomes `snapshot_add(origin)` + `origin_visit_update(origin, visit, snapshot_id=snap['id'])` | 28 March 2019, 15:01:49 UTC |
3457207 | Valentin Lorentz | 28 March 2019, 12:27:33 UTC | Add a new argument snapshot_id to origin_visit_update, and make all its arguments optional. | 28 March 2019, 12:27:33 UTC |
246855c | Valentin Lorentz | 26 March 2019, 16:11:06 UTC | Add a new JournalWriter interface, which is notified by swh-storage before writing to pgsql. | 28 March 2019, 10:42:27 UTC |
f734c4e | Antoine R. Dumont (@ardumont) | 28 March 2019, 08:58:54 UTC | api.server: Remove unneeded stats.increment call as this is already done further down the stack | 28 March 2019, 08:58:54 UTC |
3c2dfc0 | Antoine R. Dumont (@ardumont) | 27 March 2019, 18:35:23 UTC | swh.storage.api.server: Add metrics to storage endpoints | 27 March 2019, 19:24:56 UTC |
3a7f8a9 | Antoine R. Dumont (@ardumont) | 26 March 2019, 17:49:33 UTC | Add @timed decorator around all api.server endpoints | 26 March 2019, 17:49:33 UTC |
c47f92a | Antoine R. Dumont (@ardumont) | 26 March 2019, 13:46:45 UTC | storage: Add a timed decoration to count calls and time it | 26 March 2019, 14:19:43 UTC |
aaab31c | Nicolas Dandrimont | 25 March 2019, 15:26:40 UTC | Mark the node id columns as not null for directory, revision and snapshot This is an oversight from the migration to split indexes. | 25 March 2019, 15:31:28 UTC |
4ed7d0a | David Douard | 06 March 2019, 11:27:41 UTC | API: refactor the /directory/ls endpoint use the generic POST based implementation. | 18 March 2019, 15:58:11 UTC |
97981b2 | David Douard | 06 March 2019, 11:24:46 UTC | API: simplify a bit the RemoteStorage class set the exception class as class attribute wich allows to get rid of the __init__ overloading. | 18 March 2019, 15:57:14 UTC |
ca72d0d | Jenkins for Software Heritage | 13 March 2019, 14:01:03 UTC | New upstream version 0.0.130 | 13 March 2019, 14:01:03 UTC |
8bbbf9f | Valentin Lorentz | 26 February 2019, 09:50:44 UTC | Add an helper function to list all origins in the storage. | 11 March 2019, 13:20:52 UTC |
645566b | Jenkins for Software Heritage | 01 March 2019, 10:11:27 UTC | New upstream version 0.0.129 | 01 March 2019, 10:11:27 UTC |
c533d6e | Valentin Lorentz | 27 February 2019, 09:42:29 UTC | Double the timeout of revision_get. Metadata indexers often hit the limit. | 27 February 2019, 09:42:29 UTC |
f9cd4a7 | Jenkins for Software Heritage | 21 February 2019, 14:07:22 UTC | New upstream version 0.0.128 | 21 February 2019, 14:07:22 UTC |
a1b8387 | Antoine R. Dumont (@ardumont) | 21 February 2019, 13:59:02 UTC | api.server: Fix wrong exception type | 21 February 2019, 13:59:02 UTC |
332da1b | Jenkins for Software Heritage | 21 February 2019, 12:59:47 UTC | New upstream version 0.0.127 | 21 February 2019, 12:59:47 UTC |
b4f2042 | Antoine R. Dumont (@ardumont) | 21 February 2019, 12:43:53 UTC | storage.cli: Fix cli entry point name to the expected name (setup.py) | 21 February 2019, 12:43:53 UTC |
95b0b42 | Antoine R. Dumont (@ardumont) | 21 February 2019, 12:28:51 UTC | api.server: Use the right Exception for the job | 21 February 2019, 12:28:51 UTC |
247ab97 | Antoine R. Dumont (@ardumont) | 21 February 2019, 12:23:36 UTC | test_server: Refactor and fix issue for pytest on python3.5 Prior to this commit, the build failed with: TypeError: argument should be string, bytes or integer, not LocalPath | 21 February 2019, 12:23:36 UTC |
feb0fb4 | Jenkins for Software Heritage | 21 February 2019, 11:24:52 UTC | New upstream version 0.0.126 | 21 February 2019, 11:24:52 UTC |
a2db5ef | Antoine R. Dumont (@ardumont) | 21 February 2019, 11:21:42 UTC | api.server: Remove unused import | 21 February 2019, 11:21:42 UTC |
b38ecc0 | Antoine R. Dumont (@ardumont) | 21 February 2019, 11:16:32 UTC | swh.storage.cli: Migrate the api server startup in swh.storage.cli | 21 February 2019, 11:21:11 UTC |
2d500d1 | Antoine R. Dumont (@ardumont) | 21 February 2019, 10:50:52 UTC | api.wsgi: Open wsgi entrypoint and check config at startup time Related T1533 | 21 February 2019, 11:21:10 UTC |
750e292 | Antoine R. Dumont (@ardumont) | 21 February 2019, 10:49:35 UTC | api.server: Remove implicit config from Also: - add tests to the loading checks - rename run_from_webserver to make_app_from_configfile Related T1533 | 21 February 2019, 11:21:10 UTC |
2696b47 | Antoine R. Dumont (@ardumont) | 20 February 2019, 17:21:12 UTC | api.server: Make the api server load and check its configuration Related T1533 | 21 February 2019, 11:21:10 UTC |
006d102 | Valentin Lorentz | 21 February 2019, 09:18:26 UTC | Double the timeout of snapshot_get_latest. Metadata indexers often hit the limit. | 21 February 2019, 09:18:50 UTC |
0b10c28 | Antoine R. Dumont (@ardumont) | 19 February 2019, 11:05:46 UTC | Remove debian packaging from master branch Related T1532 | 19 February 2019, 11:05:46 UTC |
152cb52 | Valentin Lorentz | 15 February 2019, 14:10:09 UTC | Move origin_get_range's right after origin_get. | 15 February 2019, 14:10:09 UTC |
fe81213 | Jenkins for Software Heritage | 14 February 2019, 16:57:00 UTC | New upstream version 0.0.125 | 14 February 2019, 16:57:00 UTC |
a94451a | Antoine R. Dumont (@ardumont) | 13 February 2019, 22:55:12 UTC | api/server: Do not read configuration at each request | 13 February 2019, 22:55:12 UTC |
0a15d2b | Jenkins for Software Heritage | 12 February 2019, 13:46:07 UTC | New upstream version 0.0.124 | 12 February 2019, 13:46:07 UTC |
e2c4d38 | Antoine Lambert | 01 February 2019, 15:50:18 UTC | storage: Add origin_count method Related T1463 | 12 February 2019, 13:25:54 UTC |
1efbe5c | Valentin Lorentz | 12 February 2019, 13:14:14 UTC | Fix test to work with the latest version of swh.core. | 12 February 2019, 13:14:14 UTC |
53b3b6a | Jenkins for Software Heritage | 08 February 2019, 14:14:17 UTC | New upstream version 0.0.123 | 08 February 2019, 14:14:17 UTC |
e59eb38 | Valentin Lorentz | 06 February 2019, 15:45:13 UTC | Make Storage.origin_get support a list of origins, like other Storage.*_get methods. Backward compatibility is preserved. | 07 February 2019, 14:38:01 UTC |
eeecf6f | Valentin Lorentz | 01 February 2019, 12:30:40 UTC | Stop using _to_bytes functions. | 01 February 2019, 14:02:21 UTC |
8cb3ca2 | David Douard | 24 January 2019, 14:57:58 UTC | Use the BaseDb (and friends) from swh-core since it has migrated there. | 28 January 2019, 16:31:19 UTC |
e81def3 | Jenkins for Software Heritage | 28 January 2019, 11:02:44 UTC | New upstream version 0.0.122 | 28 January 2019, 11:02:44 UTC |
5ba5529 | Jenkins for Software Heritage | 28 January 2019, 10:36:39 UTC | New upstream version 0.0.121 | 28 January 2019, 10:36:39 UTC |
4c49b3f | Antoine Lambert | 25 January 2019, 15:14:58 UTC | storage.in_memory: Fix unknown revision handling in revision_log method | 25 January 2019, 15:37:03 UTC |
17b13af | Antoine Lambert | 25 January 2019, 15:13:49 UTC | storage.in_memory: Fix unknown origin handling in origin*_get methods | 25 January 2019, 15:15:13 UTC |
f308c10 | Antoine Lambert | 25 January 2019, 13:55:19 UTC | debian/rules: Exclude hypothesis generated data from package | 25 January 2019, 13:55:19 UTC |
ecb8cec | Jenkins for Software Heritage | 17 January 2019, 11:12:46 UTC | New upstream version 0.0.120 | 17 January 2019, 11:12:46 UTC |
76d7838 | Antoine Lambert | 15 January 2019, 15:55:56 UTC | storage: Add origin_get_range method to list all archived origins Related T1399 | 17 January 2019, 10:50:39 UTC |
69f48be | Antoine R. Dumont (@ardumont) | 11 January 2019, 15:18:36 UTC | sql/upgrades/129: Add missing trigger for origin visit update event Also no need for a new function notify_changed_origin_visit since the new function does the same as the original one. Related T1466 | 11 January 2019, 15:19:45 UTC |
63b54bf | Jenkins for Software Heritage | 11 January 2019, 11:02:06 UTC | New upstream version 0.0.119 | 11 January 2019, 11:02:06 UTC |
d19392c | Valentin Lorentz | 10 January 2019, 15:17:18 UTC | Notify Kafka when an origin visit is update. | 10 January 2019, 15:51:24 UTC |
b2145ba | Jenkins for Software Heritage | 09 January 2019, 18:51:33 UTC | New upstream version 0.0.118 | 09 January 2019, 18:51:33 UTC |
c5cee88 | Antoine Lambert | 09 January 2019, 15:24:32 UTC | storage.db: Remove unused person_add method Related D897 | 09 January 2019, 15:25:00 UTC |
1f73266 | Antoine Lambert | 09 January 2019, 15:20:24 UTC | storage.in_memory: Return copies of origin visit dicts | 09 January 2019, 15:20:24 UTC |
12a2dd6 | Antoine Lambert | 08 January 2019, 13:44:52 UTC | Add in_memory.person_get implementation and improve person tests Related T1377 | 09 January 2019, 15:16:16 UTC |
336e190 | Antoine R. Dumont (@ardumont) | 20 December 2018, 13:48:44 UTC | New upstream version 0.0.117 | 20 December 2018, 13:48:44 UTC |
fc7c534 | Antoine R. Dumont (@ardumont) | 20 December 2018, 12:11:04 UTC | listener: Make kafka client be less verbose | 20 December 2018, 12:11:24 UTC |
d124710 | Antoine R. Dumont (@ardumont) | 20 December 2018, 12:10:53 UTC | listener: Use swh.model.hashutil.hash_to_bytes | 20 December 2018, 12:10:53 UTC |
a229a07 | Antoine R. Dumont (@ardumont) | 20 December 2018, 09:55:37 UTC | listener: Add logging behavior | 20 December 2018, 10:48:35 UTC |
2a03e1c | Antoine R. Dumont (@ardumont) | 20 December 2018, 09:54:53 UTC | listener: Adapt decoding behavior depending on the object type This fixes issues regarding origin/origin_visit | 20 December 2018, 10:46:20 UTC |
a061dbb | Antoine R. Dumont (@ardumont) | 14 December 2018, 14:57:04 UTC | New upstream version 0.0.116 | 14 December 2018, 14:57:04 UTC |
daea1d3 | Antoine Lambert | 14 December 2018, 14:47:52 UTC | New upstream version 0.0.115 | 14 December 2018, 14:47:52 UTC |
d19a0d1 | Antoine R. Dumont (@ardumont) | 14 December 2018, 14:43:53 UTC | Update requirements to latest swh.core Related T1444 | 14 December 2018, 14:45:23 UTC |
02e8c76 | Antoine Lambert | 11 December 2018, 09:53:19 UTC | storage.in_memory: Use in-memory objstorage to store contents | 11 December 2018, 09:53:19 UTC |
8b9f149 | Antoine Lambert | 05 December 2018, 09:59:49 UTC | New upstream version 0.0.114 | 05 December 2018, 09:59:49 UTC |
d5e8229 | Antoine Lambert | 04 December 2018, 12:33:55 UTC | storage.in_memory: Use integer ids for origin and visit instead of tuples Related T1421 | 04 December 2018, 14:58:15 UTC |
bda7cf1 | Valentin Lorentz | 04 December 2018, 13:00:25 UTC | snapshot_add: Check the origin visit exists. Summary: Instead of failing silently (PG storage) or raising an un-documented exception (in-mem storage). Reviewers: #reviewers, anlambert Reviewed By: #reviewers, anlambert Subscribers: swh-public-ci Differential Revision: https://forge.softwareheritage.org/D769 | 04 December 2018, 14:56:12 UTC |
b6b004b | Valentin Lorentz | 04 December 2018, 13:00:25 UTC | snapshot_add: Check the origin visit exists. Instead of failing silently (PG storage) or raising an un-documented exception (in-mem storage). | 04 December 2018, 13:00:25 UTC |
4833d02 | Antoine R. Dumont (@ardumont) | 30 November 2018, 10:56:44 UTC | New upstream version 0.0.113 | 30 November 2018, 10:56:44 UTC |
12f5c5a | Valentin Lorentz | 29 November 2018, 14:58:30 UTC | Add 'recursive' argument to the in-mem storage. Summary: Also add test coverage for that feature and improve doc. Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: swh-public-ci Differential Revision: https://forge.softwareheritage.org/D737 | 30 November 2018, 10:28:16 UTC |
e5b2d50 | Antoine R. Dumont (@ardumont) | 30 November 2018, 09:28:02 UTC | New upstream version 0.0.112 | 30 November 2018, 09:28:02 UTC |
df27d11 | Valentin Lorentz | 29 November 2018, 14:58:30 UTC | Add 'recursive' argument to the in-mem storage. Summary: Also add test coverage for that feature and improve doc. Reviewers: #reviewers Differential Revision: https://forge.softwareheritage.org/D737 | 29 November 2018, 14:59:03 UTC |
d8463b1 | Valentin Lorentz | 22 November 2018, 13:38:23 UTC | Use the new doc style for {revision,release}_add. Summary: Also fix the 'committer_date' on the PG Storage's revision_add, that slipped through D676. Reviewers: #reviewers, douardda Reviewed By: #reviewers, douardda Subscribers: douardda, ardumont, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D698 | 29 November 2018, 13:40:49 UTC |
f203821 | Valentin Lorentz | 29 November 2018, 09:23:30 UTC | Fix column name in metadata_provider_get. Test Plan: Test coverage will come in the next diff Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: ardumont, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D716 | 29 November 2018, 13:40:40 UTC |
7af40f6 | Valentin Lorentz | 27 November 2018, 17:00:57 UTC | Fix documented return type of metadata_provider_add. Summary: As the in-mem storage was written based on this documentation, fix it as well. Add a test for this behavior. Depends on D716. Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: ardumont, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D717 | 29 November 2018, 09:21:43 UTC |
abee27c | Antoine Lambert | 27 November 2018, 14:39:54 UTC | Storage.release_get: Yield None for non-existent release Similar to Storage.revision_get, yields None when querying a non-existent release. | 27 November 2018, 16:31:51 UTC |
cd2db9b | Valentin Lorentz | 22 November 2018, 10:24:09 UTC | Document edge cases of content_get_range. Reviewers: #reviewers, douardda, ardumont Reviewed By: #reviewers, douardda, ardumont Subscribers: ardumont, douardda, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D694 | 27 November 2018, 10:44:12 UTC |
479ad67 | Antoine R. Dumont (@ardumont) | 12 November 2018, 16:49:36 UTC | sql: Update origin trigger to provide full origin information | 26 November 2018, 14:28:28 UTC |
d190fda | Valentin Lorentz | 23 November 2018, 16:34:57 UTC | Implement content_get and content_get_range for the in-mem storage. Summary: Needed to work on T1307 for the indexers. Reviewers: #reviewers, ardumont, douardda Reviewed By: #reviewers, ardumont, douardda Subscribers: douardda, ardumont, zack, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D695 | 26 November 2018, 14:24:36 UTC |
e894064 | David Douard | 22 November 2018, 11:00:37 UTC | doc: update index to match new swh-doc format related to T1330 | 23 November 2018, 13:48:09 UTC |
90da2a9 | Valentin Lorentz | 22 November 2018, 11:19:15 UTC | Fix docstrings for Storage.add_{release,revision}. Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: ardumont, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D676 | 22 November 2018, 12:10:31 UTC |
dd62eae | Valentin Lorentz | 21 November 2018, 16:09:05 UTC | Increase test coverage for stat_counters + fix its bugs. Reviewers: #reviewers, anlambert Reviewed By: #reviewers, anlambert Subscribers: anlambert, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D679 | 21 November 2018, 16:09:34 UTC |
5d822c9 | Valentin Lorentz | 21 November 2018, 14:47:51 UTC | Add 'inmemory' storage class in get_storage. Summary: https://forge.softwareheritage.org/D684#inline-3666 Reviewers: #reviewers, anlambert Reviewed By: #reviewers, anlambert Subscribers: swh-public-ci, ardumont, anlambert Differential Revision: https://forge.softwareheritage.org/D689 | 21 November 2018, 14:50:48 UTC |
d1ce244 | Valentin Lorentz | 20 November 2018, 10:54:02 UTC | Run property-based tests on RemoteStorage and in_memory.Storage. Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: ardumont, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D678 | 21 November 2018, 14:33:19 UTC |
37d70d6 | Valentin Lorentz | 20 November 2018, 15:04:59 UTC | Make it official that content_missing accepts missing keys. Summary: The PG Storage provides that feature, and the Git loader uses it. This commit documents that feature, adds it to the Mem Storage, and changes test_content_missing to test that behavior. Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: swh-public-ci Differential Revision: https://forge.softwareheritage.org/D680 | 21 November 2018, 14:32:35 UTC |
97b356a | Valentin Lorentz | 20 November 2018, 14:53:38 UTC | Add empty fetch_history_{start,end} endpoints to the in-mem storage. Summary: The Git loader calls them; but we're going to remove them (T829). Reviewers: #reviewers, ardumont Reviewed By: #reviewers, ardumont Subscribers: swh-public-ci Differential Revision: https://forge.softwareheritage.org/D681 | 21 November 2018, 14:32:21 UTC |
04c8faa | Antoine R. Dumont (@ardumont) | 21 November 2018, 07:55:13 UTC | New upstream version 0.0.111 | 21 November 2018, 07:55:13 UTC |
8ea06fa | Antoine R. Dumont (@ardumont) | 19 November 2018, 09:26:58 UTC | tests: Move generation tests fixture in a dedicated module So that tests that requires tests fixture without hypothesis does not break. Related T1354 | 19 November 2018, 09:28:26 UTC |
b61cf3d | Valentin Lorentz | 16 November 2018, 15:02:22 UTC | Add in-memory storage. Test Plan: Land the two parent diffs, then rebase this one on top of them. Reviewers: #reviewers, douardda Reviewed By: #reviewers, douardda Subscribers: olasd, douardda, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D645 | 19 November 2018, 09:03:52 UTC |
f09707c | Antoine R. Dumont (@ardumont) | 16 November 2018, 10:53:14 UTC | New upstream version 0.0.110 | 16 November 2018, 10:53:14 UTC |
fc3b9dc | Valentin Lorentz | 12 November 2018, 10:35:45 UTC | Document metadata providers. Reviewers: #reviewers, douardda, moranegg Reviewed By: #reviewers, douardda, moranegg Subscribers: douardda, moranegg, swh-public-ci Differential Revision: https://forge.softwareheritage.org/D637 | 15 November 2018, 09:02:57 UTC |
12edfac | Antoine R. Dumont (@ardumont) | 14 November 2018, 14:22:14 UTC | tox: Define a py3-slow environment Use: tox -e py3-slow | 14 November 2018, 15:07:33 UTC |
880aa9c | Antoine R. Dumont (@ardumont) | 13 November 2018, 09:59:41 UTC | tests: Use fast/slow profile names | 14 November 2018, 15:07:33 UTC |
3f05ada | Antoine R. Dumont (@ardumont) | 12 November 2018, 13:51:31 UTC | Makefile: Adapt makefile to use the dev profile | 14 November 2018, 15:07:33 UTC |
076a392 | Antoine R. Dumont (@ardumont) | 12 November 2018, 13:11:03 UTC | tests: Use hypothesis profile mechanism to configure samples size | 14 November 2018, 15:07:33 UTC |
04323a6 | Antoine R. Dumont (@ardumont) | 12 November 2018, 12:42:05 UTC | tests: Decrease generation sample to make tests faster Currently investigating hypothesis settings [1] [1] https://hypothesis.readthedocs.io/en/latest/settings.html#settings-profiles | 14 November 2018, 15:07:33 UTC |
8aa990f | Antoine R. Dumont (@ardumont) | 12 November 2018, 10:38:12 UTC | tests: Add docstring to test to detail what's tested | 14 November 2018, 15:07:33 UTC |
e1a460c | Antoine R. Dumont (@ardumont) | 09 November 2018, 17:40:49 UTC | tests: Move property_based marker to toplevel test class | 14 November 2018, 15:07:33 UTC |
3829885 | Antoine R. Dumont (@ardumont) | 14 November 2018, 14:08:35 UTC | tests: Use sorted | 14 November 2018, 15:07:33 UTC |
c876d86 | Antoine R. Dumont (@ardumont) | 09 November 2018, 15:27:19 UTC | storage: Open content_get_range endpoint Related T991 | 14 November 2018, 15:07:33 UTC |
a429574 | Antoine R. Dumont (@ardumont) | 14 November 2018, 13:58:33 UTC | tests: Use sorted on list directly | 14 November 2018, 15:07:33 UTC |
c7a3266 | Antoine R. Dumont (@ardumont) | 14 November 2018, 13:58:17 UTC | tests: Build content generated in less steps | 14 November 2018, 15:07:33 UTC |