3a95591 | Antoine R. Dumont (@ardumont) | 29 October 2015, 09:28:59 UTC | New upstream version 0.0.16 | 29 October 2015, 09:28:59 UTC |
0c604ad | Nicolas Dandrimont | 28 October 2015, 11:38:32 UTC | swh.storage.api.client: cache http connections with a requests Session | 28 October 2015, 16:22:47 UTC |
9b6e88d | Nicolas Dandrimont | 28 October 2015, 16:20:07 UTC | sql/upgrades/029: Add upgrade script for 028→029 | 28 October 2015, 16:22:46 UTC |
896d1dd | Antoine R. Dumont (@ardumont) | 28 October 2015, 11:44:36 UTC | sql: Bump to dbversion 29 | 28 October 2015, 11:44:36 UTC |
ba31ca3 | Antoine R. Dumont (@ardumont) | 28 October 2015, 09:40:49 UTC | Add metadata field to revision table Close T22 | 28 October 2015, 09:40:49 UTC |
a8e349c | Nicolas Dandrimont | 27 October 2015, 10:43:39 UTC | New upstream version 0.0.15 | 27 October 2015, 10:43:39 UTC |
3cf215a | Nicolas Dandrimont | 27 October 2015, 10:15:48 UTC | sql/upgrades/028: add 27→28 upgrade script | 27 October 2015, 10:15:48 UTC |
3ee65b8 | Nicolas Dandrimont | 27 October 2015, 10:12:38 UTC | sql/swh-func: bulk update directories in a temp table This should reduce the impact of vacuum on the directory table, as the final entries are put in place as is instead of performing updates on the actual table. | 27 October 2015, 10:12:38 UTC |
95cd123 | Nicolas Dandrimont | 27 October 2015, 10:00:31 UTC | sql/upgrades/027: add upgrade script 026->027 | 27 October 2015, 10:00:31 UTC |
5c2a6fc | Nicolas Dandrimont | 26 October 2015, 15:20:01 UTC | sql: update schema of organizations and projects Create a single, unified, historized hierarchy, "entity", and associated tables. Bump SQL revision. Closes T3 until proven otherwise. | 26 October 2015, 15:20:01 UTC |
04bb5cb | Nicolas Dandrimont | 26 October 2015, 13:28:53 UTC | storage: Add entry points for fetch_history | 26 October 2015, 13:28:53 UTC |
f97305c | Nicolas Dandrimont | 23 October 2015, 15:31:14 UTC | objstorage: add test for directory modes | 23 October 2015, 15:31:14 UTC |
80a264b | Nicolas Dandrimont | 23 October 2015, 15:30:45 UTC | objstorage: fix os.makedirs arguments | 23 October 2015, 15:30:45 UTC |
07ee788 | Nicolas Dandrimont | 23 October 2015, 15:21:23 UTC | objstorage: fix DIR_MODEs and race condition on dir creation | 23 October 2015, 15:21:23 UTC |
6f37943 | Nicolas Dandrimont | 23 October 2015, 15:20:37 UTC | objstorage: factor FILE_MODE and fix missed codepath | 23 October 2015, 15:20:37 UTC |
dcd9f1c | Nicolas Dandrimont | 19 October 2015, 10:32:21 UTC | sql/upgrades/026: add 025->026 upgrade script | 19 October 2015, 10:32:21 UTC |
6b8aea6 | Nicolas Dandrimont | 19 October 2015, 10:29:15 UTC | sql-func: remove useless shortcut from swh_revision_find_occurrence | 19 October 2015, 10:30:36 UTC |
f20e373 | Nicolas Dandrimont | 16 October 2015, 13:34:08 UTC | New upstream version 0.0.14 | 16 October 2015, 13:34:08 UTC |
173cc1e | Stefano Zacchiroli | 16 October 2015, 12:57:11 UTC | AUTHORS, LICENSE: sync with py-template | 16 October 2015, 12:57:11 UTC |
7a866b6 | Nicolas Dandrimont | 16 October 2015, 12:51:44 UTC | New upstream version 0.0.13 | 16 October 2015, 12:51:44 UTC |
17bd1b4 | Nicolas Dandrimont | 16 October 2015, 10:02:24 UTC | sql/upgrades: add 024 to 025 migration script | 16 October 2015, 10:02:24 UTC |
cdc8b94 | Nicolas Dandrimont | 16 October 2015, 09:55:21 UTC | sql/swh-data: Update GNU description to appease apgdiff | 16 October 2015, 09:55:21 UTC |
72eb325 | Antoine R. Dumont (@ardumont) | 16 October 2015, 08:33:05 UTC | Write/read `synthetic` column in revision/release | 16 October 2015, 09:13:10 UTC |
1ed92af | Antoine R. Dumont (@ardumont) | 16 October 2015, 08:17:31 UTC | Fix typo docstring | 16 October 2015, 09:13:10 UTC |
1217fbf | Nicolas Dandrimont | 16 October 2015, 08:56:00 UTC | storage.api.client: raise exceptions from GETs too | 16 October 2015, 08:56:00 UTC |
8cfaa01 | Stefano Zacchiroli | 15 October 2015, 15:48:46 UTC | sql/upgrades/024: upgrade script 23 -> 24 | 15 October 2015, 15:48:46 UTC |
411459c | Antoine R. Dumont (@ardumont) | 15 October 2015, 14:57:06 UTC | Add synthetic flag on release and revision tables | 15 October 2015, 15:11:12 UTC |
dad8f67 | Antoine R. Dumont (@ardumont) | 15 October 2015, 14:50:34 UTC | Add gnu.org organization | 15 October 2015, 14:50:34 UTC |
7cbea2a | Antoine R. Dumont (@ardumont) | 15 October 2015, 14:50:19 UTC | Add optional 0.0.0.0 to open dev server | 15 October 2015, 14:50:19 UTC |
04ad426 | Antoine R. Dumont (@ardumont) | 14 October 2015, 14:58:58 UTC | Update sample command line | 14 October 2015, 14:58:58 UTC |
5f511b8 | Stefano Zacchiroli | 14 October 2015, 08:56:24 UTC | storage API client: support argument-less methods | 14 October 2015, 08:56:24 UTC |
166ace6 | Stefano Zacchiroli | 14 October 2015, 08:56:06 UTC | remote storage: expose /stat/counters | 14 October 2015, 08:56:06 UTC |
634c24e | Stefano Zacchiroli | 14 October 2015, 08:48:53 UTC | swh.storage.db: remove overzelous spacing in very short functions cosmetic change | 14 October 2015, 08:48:53 UTC |
d63124a | Stefano Zacchiroli | 14 October 2015, 08:47:50 UTC | new SQL function: swh_stat_counters() returning the number of tuples in various tables expose it through the Python layer | 14 October 2015, 08:47:50 UTC |
19973fa | Antoine R. Dumont (@ardumont) | 13 October 2015, 12:52:13 UTC | SQL function: Add fixme to `ls` directory | 13 October 2015, 12:58:00 UTC |
5002bd5 | Antoine R. Dumont (@ardumont) | 13 October 2015, 12:51:25 UTC | SQL func: Add `ls -lr` on a directory | 13 October 2015, 12:58:00 UTC |
793fb06 | Stefano Zacchiroli | 13 October 2015, 12:45:02 UTC | SQL schema: add index on content(ctime) | 13 October 2015, 12:45:02 UTC |
f58bdea | Nicolas Dandrimont | 13 October 2015, 10:39:18 UTC | New upstream version 0.0.12 | 13 October 2015, 10:39:18 UTC |
672dd1c | Nicolas Dandrimont | 13 October 2015, 10:27:01 UTC | objstorage: create files as mode 0o644 | 13 October 2015, 10:27:01 UTC |
3bb88fe | Nicolas Dandrimont | 12 October 2015, 14:50:45 UTC | sql/swh-func: mark SELECT functions as stable This allows inlining of the language sql functions that only select data from the database. | 12 October 2015, 14:51:02 UTC |
3c6b874 | Nicolas Dandrimont | 12 October 2015, 13:53:31 UTC | sql/swh-func: update swh_revision_find_occurrence with swh_revision_list_children | 12 October 2015, 13:53:31 UTC |
2542bdf | Nicolas Dandrimont | 12 October 2015, 13:53:05 UTC | sql/swh-func: add swh_revision_list_children | 12 October 2015, 13:53:05 UTC |
cd8b425 | Nicolas Dandrimont | 12 October 2015, 13:52:37 UTC | sql/swh-schema: add various indexes for reverse queries on contents | 12 October 2015, 13:52:37 UTC |
ba7df27 | Nicolas Dandrimont | 09 October 2015, 15:44:51 UTC | New upstream version 0.0.11 | 09 October 2015, 15:44:51 UTC |
cefe4d0 | Nicolas Dandrimont | 09 October 2015, 15:44:11 UTC | sql/upgrades/022: update type revision_log_entry | 09 October 2015, 15:44:11 UTC |
ba64d1a | Nicolas Dandrimont | 07 October 2015, 16:49:54 UTC | sql/upgrades/023: add upgrade 022->023 | 07 October 2015, 16:49:54 UTC |
3ddcc6a | Nicolas Dandrimont | 07 October 2015, 16:42:37 UTC | storage: add revision_get | 07 October 2015, 16:43:25 UTC |
a18c612 | Nicolas Dandrimont | 07 October 2015, 16:40:10 UTC | test_storage: use proper types for revisions | 07 October 2015, 16:43:25 UTC |
42f7713 | Nicolas Dandrimont | 07 October 2015, 16:39:36 UTC | db: allow decoding arrays of byteas | 07 October 2015, 16:43:25 UTC |
1350fc9 | Nicolas Dandrimont | 07 October 2015, 16:39:06 UTC | sql: add listing of revisions from tmp_revision | 07 October 2015, 16:43:25 UTC |
c4b1345 | Stefano Zacchiroli | 07 October 2015, 13:52:06 UTC | DB schema chart: include version number | 07 October 2015, 13:52:06 UTC |
dbc238f | Nicolas Dandrimont | 07 October 2015, 13:30:17 UTC | tests: fix flake8 | 07 October 2015, 13:30:17 UTC |
d2495d0 | Nicolas Dandrimont | 07 October 2015, 07:01:55 UTC | sql/upgrades/022: drop default before changing the type. | 07 October 2015, 07:01:55 UTC |
3c66ff6 | Nicolas Dandrimont | 06 October 2015, 15:37:00 UTC | New upstream version 0.0.10 | 06 October 2015, 15:37:00 UTC |
a4fb8df | Nicolas Dandrimont | 06 October 2015, 12:11:12 UTC | sql: add upgrade script for 21->22 | 06 October 2015, 12:11:12 UTC |
e80adb8 | Nicolas Dandrimont | 06 October 2015, 11:54:01 UTC | swh-schema: person (name, email) -> bytea Closes T65 in part | 06 October 2015, 12:01:40 UTC |
5e7fd18 | Stefano Zacchiroli | 05 October 2015, 20:15:18 UTC | sql/TODO: updated to reflect current status | 05 October 2015, 20:15:18 UTC |
04367e1 | Nicolas Dandrimont | 05 October 2015, 16:57:14 UTC | swh.storage.occurrence_add: parse string dates with dateutil | 05 October 2015, 16:57:14 UTC |
1f7ca7c | Nicolas Dandrimont | 05 October 2015, 16:41:37 UTC | swh.storage.storage: make occurrence_add support overlapping intervals Closes T45 | 05 October 2015, 16:47:16 UTC |
71c4ab6 | Nicolas Dandrimont | 05 October 2015, 16:40:22 UTC | swh.storage.db: plug swh_occurrence_history_add | 05 October 2015, 16:47:16 UTC |
c91dd71 | Nicolas Dandrimont | 05 October 2015, 16:39:24 UTC | swh.storage.db: proper copy escaping for datetimes, ranges | 05 October 2015, 16:47:16 UTC |
3a44ef5 | Nicolas Dandrimont | 05 October 2015, 16:45:58 UTC | sql/upgrades/021: add 020->021 upgrade script | 05 October 2015, 16:47:16 UTC |
b3aac6a | Nicolas Dandrimont | 05 October 2015, 16:38:05 UTC | swh-func: add swh_occurrence_history_add() | 05 October 2015, 16:38:05 UTC |
3c1f401 | Nicolas Dandrimont | 05 October 2015, 14:11:19 UTC | sql/upgrades/020: add upgrade script for 19->20 | 05 October 2015, 14:11:19 UTC |
103950b | Nicolas Dandrimont | 05 October 2015, 14:00:51 UTC | sql/swh-func: add table aliases to "where not exists" queries | 05 October 2015, 14:00:51 UTC |
c4bb88d | Nicolas Dandrimont | 05 October 2015, 08:45:01 UTC | swh.storage.tests: Actually check the error message | 05 October 2015, 08:45:01 UTC |
bf9253e | Nicolas Dandrimont | 05 October 2015, 08:33:42 UTC | swh.storage.tests: clean the database on teardown | 05 October 2015, 08:42:10 UTC |
fedd0ff | Stefano Zacchiroli | 05 October 2015, 08:00:30 UTC | storage.content_find: better testing | 05 October 2015, 08:00:30 UTC |
96adeaa | Stefano Zacchiroli | 04 October 2015, 18:39:46 UTC | storage.content_find: refactor argument checking also: - avoid overzeaolus assertion in test, to make it more robust - improve method doc string | 04 October 2015, 18:52:00 UTC |
f1fb64c | Stefano Zacchiroli | 03 October 2015, 12:44:03 UTC | sql/bin/db-upgrade: compute SQL upgrades using git and apgdiff | 03 October 2015, 12:44:03 UTC |
07c8f44 | Nicolas Dandrimont | 02 October 2015, 15:18:34 UTC | sql: Improve performance of swh_{directory,revision,release}_missing | 02 October 2015, 15:18:34 UTC |
412df3d | Nicolas Dandrimont | 01 October 2015, 17:03:00 UTC | New upstream version 0.0.9 | 01 October 2015, 17:03:00 UTC |
08ffeb2 | Nicolas Dandrimont | 01 October 2015, 17:02:10 UTC | Remove atime, mtime, ctime from directory entries | 01 October 2015, 17:02:10 UTC |
617de19 | Nicolas Dandrimont | 01 October 2015, 09:32:46 UTC | New upstream version 0.0.8 | 01 October 2015, 09:32:46 UTC |
43f5bf9 | Nicolas Dandrimont | 01 October 2015, 09:32:07 UTC | Bump swh.core dependency version | 01 October 2015, 09:32:07 UTC |
a718e9d | Stefano Zacchiroli | 30 September 2015, 14:17:10 UTC | db.py: drop raises psycopg2.internalerror it is no longer the case | 30 September 2015, 14:17:10 UTC |
64a7832 | Stefano Zacchiroli | 30 September 2015, 12:51:01 UTC | objstorage: fix predictable tempfile race when adding objects Before this change, two workers adding the same object will end up racing to write <SHA1>.tmp. That should not lead to corruption, because they are (in principle) going to write the exact same content, but it made the one of the two that arrives last fail the final rename. With this fix they will write in different <SHA1>.RANDOM_STUFF.tmp, and then rename their own file into place. Note that this change slightly increases the chances of having garbage in the object store, so we will need to look for this during GC passes. | 30 September 2015, 12:51:01 UTC |
e4feb05 | Stefano Zacchiroli | 30 September 2015, 10:31:16 UTC | upgrades/17.sql: add recent changes | 30 September 2015, 10:33:00 UTC |
25b0544 | Stefano Zacchiroli | 30 September 2015, 09:56:25 UTC | swh-func.sql: use LANGUAGE sql wherever possible Overall, we can use LANGUAGE sql only in 6 cases (vs 17 functions that remains plpgsql). This is in large part due to the fact that LANGUAGE sql stored procedures cannot non-existent tables, and most notably temporary tables. Closes T55. | 30 September 2015, 10:33:00 UTC |
cd507ba | Stefano Zacchiroli | 30 September 2015, 10:11:55 UTC | SQL: nicer API for swh_content_find_* functions the functions no longer fail with internal errors (due to "insert into ... strict"), but rather return NULL in those cases, because no match has been found. | 30 September 2015, 10:33:00 UTC |
d4131b3 | Antoine R. Dumont | 30 September 2015, 09:48:37 UTC | Update docstring | 30 September 2015, 09:48:46 UTC |
7fe460f | Stefano Zacchiroli | 30 September 2015, 09:01:43 UTC | bump SQL schema version to 17 include upgrade script from 16 | 30 September 2015, 09:04:30 UTC |
be72b19 | Stefano Zacchiroli | 30 September 2015, 08:57:00 UTC | sql-func refactoring: single dir*_entry_add function The function is parametric in the type of entries to be added (file/dir/rev). Get rid of the previous 3 (99% overlapping) functions swh_directory_{file,rev,dir}_entry_add functions. Make storage.py use the new function. | 30 September 2015, 09:04:30 UTC |
4612bc6 | Antoine R. Dumont | 30 September 2015, 08:57:31 UTC | Refactor - pep8 compliance - Remove unused import | 30 September 2015, 08:57:57 UTC |
c956386 | Antoine R. Dumont | 30 September 2015, 08:39:42 UTC | Improve output response for find occurrence api | 30 September 2015, 08:56:54 UTC |
141d392 | Antoine R. Dumont | 29 September 2015, 15:32:07 UTC | Implement content_find_occurrence up to the db | 30 September 2015, 08:43:30 UTC |
3e2fe23 | Antoine R. Dumont | 29 September 2015, 14:54:34 UTC | Refactor - db.py returns None or the content found The triplet of None should be sandboxed to db.py | 30 September 2015, 08:43:30 UTC |
91debb1 | Antoine R. Dumont | 29 September 2015, 13:52:57 UTC | Refactor - Permit reuse of the content_find api | 30 September 2015, 08:43:30 UTC |
6944ab8 | Antoine R. Dumont | 29 September 2015, 13:18:15 UTC | Refactor - Return result directory Remove the needless yield | 30 September 2015, 08:42:51 UTC |
311de1b | Antoine R. Dumont | 29 September 2015, 13:08:20 UTC | Refactor - Reuse | 30 September 2015, 08:42:51 UTC |
df4bdfa | Antoine R. Dumont | 29 September 2015, 12:16:27 UTC | Open content-find-occurrence | 30 September 2015, 08:42:51 UTC |
bdfc021 | Stefano Zacchiroli | 30 September 2015, 07:33:27 UTC | test_storage: add collision detection test | 30 September 2015, 07:40:40 UTC |
9aa18e4 | Stefano Zacchiroli | 30 September 2015, 07:25:06 UTC | test_api_client: use absolute import to allow rm __init__.py | 30 September 2015, 07:25:06 UTC |
b4e4b20 | Stefano Zacchiroli | 30 September 2015, 07:18:22 UTC | SQL swh_content_missing: build result incrementally by uniting on contents that appear to be missing when looking at a single checksum algorithm. This is semantically equivalent to the previous approach, but allows to exploit single-column indexes; which are non-redundant, smaller, and hence more likely to be used. This is the "metro ligne 6" approach. | 30 September 2015, 07:18:22 UTC |
7a33494 | Stefano Zacchiroli | 29 September 2015, 16:15:56 UTC | db_testing.py: allow to customize DB restore | 29 September 2015, 16:15:56 UTC |
8fc078f | Nicolas Dandrimont | 29 September 2015, 14:52:54 UTC | New upstream version 0.0.7 | 29 September 2015, 14:52:54 UTC |
f88331c | Nicolas Dandrimont | 29 September 2015, 14:51:45 UTC | Bump dependencies on swh.core to >= 0.0.6 | 29 September 2015, 14:51:45 UTC |
bfe9016 | Nicolas Dandrimont | 29 September 2015, 14:51:25 UTC | debian/control: indent with spaces | 29 September 2015, 14:51:25 UTC |
d4b8374 | Nicolas Dandrimont | 29 September 2015, 14:43:24 UTC | New upstream version 0.0.6 | 29 September 2015, 14:43:24 UTC |
e424885 | Nicolas Dandrimont | 29 September 2015, 14:36:32 UTC | Bump dependency on swh.core | 29 September 2015, 14:41:40 UTC |