https://github.com/Paradigm4/shim

sort by:
Revision Author Date Message Commit Date
8f4000f Merge branch 'master' into v22.5 24 April 2023, 19:47:16 UTC
d988a52 Update SciDB badge in Shim 15 March 2023, 00:31:36 UTC
d511c39 Merge pull request #131 from Paradigm4/feature/doc-update Updating documentation to describe 'weak' endpoints 05 March 2023, 17:38:54 UTC
14546b3 Updating documentation to describe 'weak' endpoints 23 February 2023, 15:13:09 UTC
892787e Merge branch 'master' into v22.5 14 February 2023, 02:45:35 UTC
25af969 Updating copyright information 10 February 2023, 19:14:56 UTC
97bf389 Standardize log format (#129) * Exposing mongoose code in header that wraps inet calls to convert the connection's remote IP address into a string; stores this string in the session info and reports it in logs * Adding helper macros to populate logs with session information in a structured format; adjusting verbosity of logs printing query strings or results to LOG_DEBUG * By default, use a JSON encoded syslog message, overrideable by the setting of the SHIM_JSON_LOG_FORMAT environment variable. * Describing log formats in README file 09 February 2023, 14:33:29 UTC
e0d7d7d Merge branch 'master' into v22.5 28 January 2023, 02:54:34 UTC
22f1bfe Merge pull request #126 from Paradigm4/feature/truncate-obuf-files Truncate obuf files after they are fully returned 25 January 2023, 19:02:55 UTC
834d635 Updating session timestamps after successful read_bytes and read_lines calls with n=0 25 January 2023, 15:29:58 UTC
89b1410 Clarifying meaning of regular and weak modes in comments; reverting removed free(lbuf) 24 January 2023, 14:18:49 UTC
6e39f74 The read.sh unit test requires several sorts of updates: * using weak read calls where consecutive reads of the buffer are performed * using the new read calls where relevant * removing misleading tests when performing multiple saves followed by multiple reads, because shim does not store multiple consecutive query results in a queue and so these multiple reads just return the most recent. 23 January 2023, 14:51:59 UTC
bc34308 Adapting new read_bytes behavior for read_lines and enabling the new analogous test cases for the latter 20 January 2023, 22:19:05 UTC
29f0425 Correct fallback read_bytes_weak behavior to return a 416 error when the EOF of the obuf has been reached; better document the logic and use of the separate cases within read_bytes. Make the status_code unit test more robust by replacing `list()` with `limit(list(),0)`, so that dev machine behavior better matches test machine behavior; adjust stanza expecting 416 codes to use the read_bytes_weak and read_lines_weak endpoints; and add tests for reading bytes from saved output, reading EOF signal, and then receiving HTTP 410 Gone error. 20 January 2023, 22:04:34 UTC
7810fa0 Truncating about buffer upon successful reading of the entire buffer, or of its last bytes. Similar logic for read_lines to be added. Also includes some helpful improvements to logging, such as printing the names of the buffer files rather than hex values. 20 January 2023, 14:17:26 UTC
427c588 Merge branch 'master' into v22.5 03 January 2023, 01:01:46 UTC
6b41753 Merge pull request #125 from Paradigm4/actions-upgrade Actions upgrade 03 January 2023, 01:00:32 UTC
85b0938 Fix version of host OS 02 January 2023, 21:13:50 UTC
24fd913 Upgrade actions to supress Node.js warnings 02 January 2023, 20:41:33 UTC
838f427 Use devtoolset-9 for 21.8 and above. * Update GitHub Actions workflows 03 July 2022, 01:10:52 UTC
52c16fa Use devtoolset-9 for 21.8 and above. * Update GitHub Actions workflows 03 July 2022, 00:50:04 UTC
d991eb4 Wait for SciDB to sync before continuing the test (#124) * Run sync() until succeeds after SciDB start in test 17 30 June 2022, 04:53:49 UTC
df2436b Update test workflow to use 22.5 version/branch 27 June 2022, 19:02:19 UTC
e8d6b43 Normalize whitespace, replace TAB with space 16 May 2022, 03:53:14 UTC
c56ccde Merge pull request #123 from Paradigm4/rsamuels/shim-rollback-sdb-7521 Fix rollback handling 09 December 2021, 18:10:09 UTC
afddb7a Fix rollback handling The rollback() command produces a RollbackException when successful. The shim should treat this as success instead of as an error, but it shouldn't call completeQuery() after receiving this exception. 07 December 2021, 22:21:17 UTC
ca1f50a Fix cancellation in SciDB 21.8 SciDB 21.8 no longer supports executing a query without preparing it first. The only place this was done was in cancel() in the shim. This commit modifies executeQuery() so that it always prepares the query before executing it, making cancellation compatible with SciDB 21.8. 19 November 2021, 03:21:46 UTC
9643f4c Use a second session to check for running queries Otherwise the list() query waits until the delay query finishes. So, the failure in the cancel request is never caught 19 November 2021, 02:30:58 UTC
9e46c0d Keep Shim output to detect test start failures 19 November 2021, 02:30:17 UTC
18d98f4 Fix syntax/typo 11 November 2021, 17:26:12 UTC
5dbb5cc Use devtoolset-9 to build shim and required plugins 10 November 2021, 23:38:57 UTC
02f8256 Use SciDB 21.8 images, update ref 19.11->21.8 10 November 2021, 23:26:09 UTC
edbc3a1 Merge pull request #119 from Paradigm4/v19.11 GitHub Actions support 10 November 2021, 23:21:25 UTC
0041e4a Drop setup/action script, use bundled Bash scripts to setup SciDB 10 November 2021, 18:03:57 UTC
e3b0306 Reap oldest timeout session based on last updated time * Update reap test https://app.clickup.com/t/1uf849g 05 November 2021, 23:37:08 UTC
6037287 Seed random number generator to get unique session IDs at restart 05 November 2021, 23:06:48 UTC
7c8bddd Minor formatting 05 November 2021, 23:06:29 UTC
acd6877 Add test for session reap 05 November 2021, 19:19:23 UTC
5cbc89c Remove Travis badge 05 November 2021, 00:33:19 UTC
3178960 Setup GitHub Actions to run Shim tests on SciDB EE (#118) * Initial workflow and actions script * Checkout code * Install and start SciDB * Use Python, compile and install Shim * Add all tests * Fix env var set syntax * Checkout and build superfunpack * Set separate checkout path, add debug step to verify contents * Fix paths in Docker, install suprefunpack, split shim install steps * Remove redundant "shell: bash" * Use env to set environment variable * Add env variable for 'test' target as well * Use image with 3rd party libs, compile and load accelerated_io_tools * Fix starting Shim * Set LD_LIBRARY_PATH * Add Badge in README 05 November 2021, 00:31:25 UTC
b96ac1b boost_system no longer needed on link line. 10 September 2021, 16:33:19 UTC
465eb67 Makefile changes for using boost169 10 September 2021, 16:24:24 UTC
e921061 Makefile changes to support devtoolset-9 for v21.8 09 September 2021, 18:08:23 UTC
0ece1b8 Simplify Arrow version tracking 24 July 2020, 00:18:12 UTC
3c815f3 Install Arrow 16 from official repo 24 July 2020, 00:05:01 UTC
57ed382 Use latest accelerated_io_tools and curretn supported Arrow * Use env var for accelerated_io_tools version 24 July 2020, 00:04:46 UTC
3bac34a Merge pull request #116 from Paradigm4/skip-service Flag to allow for systemctl failures during installation 21 July 2020, 03:57:12 UTC
77e6d71 Use EXTRA_SCIDB_LIBS_SYSTEMCTL_FAIL_OK only for specific commands 20 July 2020, 19:10:15 UTC
96b1ca1 Skip setting up Shim service if environmen variable is set Set: SKIP_SHIM_SERVICE=true to skip setting up Shim service during extra-scidb-libs package installation. 20 July 2020, 17:59:59 UTC
edb6316 Update 19.3 references to 19.11 20 July 2020, 17:51:04 UTC
8b45059 Fix for https://github.com/Paradigm4/extra-scidb-libs/issues/31 * Check if configuration file exists and only create it if it does not exist * Check if certificate file exists and only create it if it does not exist Need to test in extra-scidb-libs 16 July 2020, 01:20:20 UTC
d8c659d Fix left-over reference to shim.service * Discovered while investigating https://github.com/Paradigm4/extra-scidb-libs/issues/26 15 July 2020, 03:17:16 UTC
9275c83 Merge pull request #114 from Paradigm4/autocommit-no-client-commit Shim no longer completes an auto-commit query 08 July 2020, 02:12:54 UTC
8a304c7 Shim won't request an autocommit query to complete. Clients shouldn't ask SciDB to complete a query that is marked auto-commit. Certain DDL, like create_array queries, auto-commit by design. Tested for memory leaks with 'valgrind --leak-check=full' while running the script found here: https://github.com/rvernica/docker-library/issues/12#issuecomment-652387862 07 July 2020, 19:50:56 UTC
6088902 Fix link to SciDB release 27 May 2020, 03:11:22 UTC
15d4e37 Merge pull request #113 from Paradigm4/travis Refactor Travis setup and tests 11 May 2020, 03:36:47 UTC
549dc10 Use all test queries to reduce load 11 May 2020, 02:38:51 UTC
ff43141 Full scale up of tests 11 May 2020, 02:19:43 UTC
7670ac7 Use single query, don't remove arrays, add comments 11 May 2020, 02:10:21 UTC
ccc1829 Re-factor docker setup in script * Run basic and extended tests * Test in Debian image as well 10 May 2020, 02:59:27 UTC
2c4a4e2 Re-factor and split tests in two * test_basic do not require any plug-ins * test requires aio and superfunpack plugins 10 May 2020, 02:56:14 UTC
9c95dd5 Refactor test 10 May 2020, 02:56:00 UTC
dc75bfa Add flag to run tests with and without AIO * Add extra configuration file with AIO enabled * Use new configuration file if AIO=aio flag is set in environment 10 May 2020, 02:52:02 UTC
9fb79fa Fix env var name to Docker image version 09 May 2020, 22:01:13 UTC
2601ee7 Add CentOS required volumes 09 May 2020, 21:55:26 UTC
cf57f8f Disable verbose printout 09 May 2020, 21:50:38 UTC
c3b6e5e Try build without sudo, dist and group 09 May 2020, 21:40:14 UTC
312511c Start and stop Shim in CentOS 7 08 May 2020, 16:08:34 UTC
0174078 Add Travis build for CentOS 7 08 May 2020, 04:29:47 UTC
16fe182 Fix typo, fix #106 08 May 2020, 01:01:24 UTC
005afc7 Update SciDb version badge 06 May 2020, 04:00:57 UTC
86f390f Use latest release ofr aio_tools 19.11.2 06 May 2020, 03:57:00 UTC
6372327 Merge pull request #110 from Paradigm4/v19.11-cxxflags CXXFLAGS clean-up 30 April 2020, 21:39:52 UTC
f87f3e7 Merge pull request #112 from Paradigm4/v19.11 v19.11 promotion to master 29 April 2020, 04:05:06 UTC
a37e227 Merge commit '3b75a358b8ea4c264cc9771548e2c317f91d6af5' into v19.11-cxxflags 31 March 2020, 01:52:20 UTC
8b24e87 Merge commit '30a863622a44d53a5dfea07d3ccfe0fb48bac151' into v19.11-cxxflags 31 March 2020, 01:52:10 UTC
12939a7 Merge commit '02c2a3ac415db5998ca20e7693650327630e528b' into v19.11-cxxflags 31 March 2020, 01:51:58 UTC
3b75a35 Reduce pytest threads even more 30 March 2020, 18:28:27 UTC
30a8636 Reduce number of threads even further for pytest 30 March 2020, 18:11:29 UTC
02c2a3a Half the number of concurent threads in pytest 30 March 2020, 17:52:11 UTC
06cfb0f Merge commit 'f87b01a' into v19.11-cxxflags 28 March 2020, 02:52:57 UTC
f87b01a Fix Travis syntax 28 March 2020, 02:48:27 UTC
fc01189 Separate build image and SciDB version 28 March 2020, 02:46:44 UTC
62d6a1b Clean up CXXFLAGS - avoid overwrite and duplication 28 March 2020, 02:38:04 UTC
21a5bc7 Fix test using new list() result schema 28 March 2020, 02:35:39 UTC
9a75f35 Use Xenial image and cleanup 28 March 2020, 02:35:17 UTC
98b172e No need to install gcc/g++, already installed in Docker container 28 March 2020, 01:15:53 UTC
9c6801e Try and stop shim service since it is now available in Docker image 28 March 2020, 01:15:22 UTC
da953bb Use v19.11 branch of accelerated_io_tools 28 March 2020, 01:14:48 UTC
f3af570 Merge branch 'master' into v19.11 * Include #108 in v19.11 27 March 2020, 19:19:11 UTC
4bdb49d Merge pull request #108 from CarlsonP4/master Use default gcc if version >= 4.9 27 March 2020, 19:06:05 UTC
e330f5a Use default gcc if version >= 4.9 On ubuntu 16.04, the default /usr/bin/g{cc,++} compiler is used to build SciDB. The c++ ABI chaged with the libstdc++ library has changed for g++ 5. Since SciDB uses the NEW ABI, the compilation of shim with the older g++-4.9 is unable to use the symbols from the New ABI. (That is, the libstdc++ is backwards compatible, but the libstdc++ used by gcc 4.9 is not forward compatible) g++ (Ubuntu 5.4.0-6ubuntu1~16.04.12) 5.4.0 20160609 Copyright (C) 2015 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. 26 March 2020, 21:40:23 UTC
07a0204 Undo change on Ubuntu reposiotry and use 14.06 26 March 2020, 15:39:49 UTC
9e332d9 Skip checking and stopping Shim, use 16.04 repo Shim not available in the `19.11` image so don't check that Shim started and don't stop Shim for now. This should be reverted when Shim becomes available in the image. Also use the Ubuntu 16.04 repository. 26 March 2020, 15:32:21 UTC
a170e1f Merge pull request #109 from dgosselin-p4/sdb-6807 Guarantee Query Side-Effects Complete 26 March 2020, 15:27:23 UTC
cb38748 Revert "Point travis at SciDB 19.11-centos-7" This reverts commit f40c06cf4fabed128134156eda0d44d10b30705c. 26 March 2020, 13:55:49 UTC
bd91f5b Ubuntu changes to support v5 compiler. 24 March 2020, 20:39:04 UTC
f40c06c Point travis at SciDB 19.11-centos-7 24 March 2020, 17:14:27 UTC
94d3eb6 Point travis at SciDB 19.11 24 March 2020, 14:53:28 UTC
71f0e04 Before this change, and in the case that the client ignores the query result (either by supplying '-n' with iquery or not pulling the result array here in the shim) then any side-effects of query execution are not guaranteed to occur. For example, a query like 'apply(arr, x, func(v))' that is executed but not pulled by the client will not guarantee that function 'func' is applied to every v in arr. This change, and the corresponding change in SciDB, is a temporary workaround until CCM roll-out occurs, whereby a consume() is injected at the root of the query when the client indicates that they will not pull the query result. In that case, consume() acts to pull the result array on every instance, therby ensuring side-effects occur just as they would had the client pulled the result array. Fixes read.sh test script to accomodate list() output format change. 22 February 2020, 16:03:03 UTC
back to top