https://github.com/voldemort/voldemort

sort by:
Revision Author Date Message Commit Date
e41339f Releasing Voldemort 1.9.6 03 February 2015, 23:21:42 UTC
13e984a Many Build And Push improvements: - Upgraded Azkaban dependency to 2.5.0, and fetch from Maven Central. Removed Azkaban from private-lib. - Upgraded Jackson dependency to 1.9.13. - Fixed BnP hooks default config (other it failed when unspecified). - Rethrow exceptions caught in BnP's run function to maintain previous behavior. - Sanity checks and better error reporting of avro configs. - Cleaned up duplicate references of UndefinedPropertyException. 03 February 2015, 18:56:38 UTC
6cac0af Add string definition for bnp job property keys 02 February 2015, 22:07:19 UTC
2efc0b2 Test fixes 1) Sometimes starting the voldemort server fails with the error ObsoleteVersion Exception. This is an override only used by the tests, so it is safe to modify it. 2) On Java 8, ConsistencyFetcher test fails as the set has a different ordering, probably because of the hashCode implementation difference. In this method ordering is not important so I modified the test to ignore the ordering. 31 January 2015, 01:10:42 UTC
1a9e8df Avoid extra allocation on AvroGenericVersioned The buffer is unnecessarily copied into a new Array which uses extra memory. Used a different API which takes in buffer, offset and length. This is what the previous call we used internally calls into. 31 January 2015, 01:10:42 UTC
e90b885 Added support for custom hooks in the VoldemortBuildAndPushJob. Heartbeat hooks run in a daemon thread. 28 January 2015, 00:29:15 UTC
4a7b365 Better IntelliJ IDEA support in the gradle build. 23 January 2015, 21:45:10 UTC
8bfd182 Read after truncate crashes the JVM If you truncate a read-only store and send read operations get/getall for one of the existent keys it crashes the JVM with SegFault. Some of the data is cached in java collections and it tries to access the memory mapped file which has been closed by the truncate. This causes the JVM to crash. Now the java collections are cleared and the code tries to handle this gracefully. But this is not an ideal code more of a workaround. Fixed spewing of log messages to the standard output, as they are already captured in the log4j loggers. Added unit test for the read after truncate scenario. 22 January 2015, 19:56:41 UTC
8e54d87 Retry on bind exceptions Retry 3 times on bind exceptions before giving up. Most of the tests fail with intermittent bind exceptions. 21 January 2015, 00:24:53 UTC
851625f ync the metadata version on all nodes Sync the metadata version on all nodes by computing the super set of version clock and the timestamp for all the stores. The vector clocks on the nodes have diverged so much because of the bugs, this option just computes the super set and fixes it. 17 January 2015, 02:55:24 UTC
fdbad13 Release voldemort 1.9.5 Releasing voldemort version 1.9.5 12 January 2015, 23:34:27 UTC
bfd1ec7 Version clock increments on each restart Voldemort verion clock increments on each restart and hence rejects future updates. Increment the clock only when necessary. Ideally if the version value already exists, the function should return early, but not sure when cluster.xml, stores.xml and for each stores a key was introduced. And what happens if the keys were not there. So found a safe middle ground to increment the version when the key is not there. 10 January 2015, 00:22:29 UTC
8387603 Cluster state equals and node names Cluster.equals returns true when the outline of the cluster is equal and when the node names are different. But this is not what we want in most cases. Let us say that you have a non-zoned cluster, on 2 different data centers. They are going to have the same node ids, same partitions but they are not equal. Even within the same data center if one cluster.xml has node 1 as A and other cluster.xml has node 1 as B, they are different but currently returns true. So modified the node equivalence to verify the equality. 09 January 2015, 22:41:19 UTC
fd71c8c ReplaceNodeCLI enhancements and tests 1) Made ReplaceNodeCLI unit testing friendly, removed System.exits with throw Exception and quitting in the main method instead of each methods. 2) Added post condition checks to the ReplaceNodeCLI to verify for consistent stores.xml and cluster.xml. Added the testing for ReplaceNode 1) Check if a node can be swapped when it is down 2) Check if a node can be swapped when it is up 3) Check if you can move a hard disk and replace a node down While doing the tests, there are many client threads simulating the traffic to make sure that they dont see any exceptions. 09 January 2015, 22:40:49 UTC
a033aba Enhance meta check to pinpoint different properties Enhance the meta check tool to pinpoint properties that are different. On stats cluster there are many properties and it is hard to see which one is different. So the tool analyzes the property level details and dumps them out. 08 January 2015, 00:13:03 UTC
4b9e652 Format the meta check-version output Formatted the meta check-version output to print the time a particular key was modified. This will help us in debugging the cluster bootstrap issues faster. 07 January 2015, 07:48:06 UTC
0f689dc ClusterVersion might be outdated after host swap Set the cluster version at the end of the host swap to help the client rebootstrap. 07 January 2015, 07:48:06 UTC
00ff96c Share the constant for cluster.xml, stores.xml Share the same Constant from SystemStoreConstants for stores.xml cluster.xml and metadata-versions. Previously each class declared its own constant and searching for the usage within the source was a nightmare. I had to do multiple file searches to piece together information. This will help in the future to make the dependencies easier to track. 07 January 2015, 07:48:05 UTC
b35755b Format only edited lines setting Format only edited lines setting 07 January 2015, 07:48:05 UTC
6e3f03c output the version numbers in meta check output the version numbers in the meta check command. This will help to debug the version numbers more easily. 07 January 2015, 07:48:05 UTC
14e6d54 Refactoring the test cases Further refactored the test cases. Tried to solidify the test case by adding more checks and saw that most of them failed because of existing bugs. So commented them out and left whatever comments I know of in those places. 07 January 2015, 07:48:05 UTC
27387e0 Merge pull request #236 from jwlent55/krati-entry-iteration-bug Fix the Krati entries iterator to properly handle key collisions. 03 January 2015, 09:55:31 UTC
a4b2678 Fix the Krati entries iterator to properly handle key collisions. 30 December 2014, 19:20:05 UTC
4e31f74 Merge pull request #235 from ctasada/issue234 Fixes issue voldemort/voldemort#234 Thanks for the fix, but the transform is not production tested and it has lots of rough edges. We are not using it internally so far. 23 December 2014, 19:37:27 UTC
e8125ef Merge pull request #233 from ctasada/issue232 Fixes voldemort/voldemort#232 23 December 2014, 19:32:18 UTC
b1363b2 Merge pull request #219 from ctasada/release-1.9.0-fixes Script fixes for latest Release - Verified that only windows batch files are affected. 23 December 2014, 19:27:08 UTC
5504d0a Fixes issue voldemort/voldemort#234 23 December 2014, 14:24:19 UTC
815a882 Fixes voldemort/voldemort#232 23 December 2014, 14:19:50 UTC
891dd95 Minor fixes for DeleteKeysCLI Added few minor fixes for DeleteKeyCLI 19 December 2014, 01:14:04 UTC
35414b4 Reformat and correct unit test for ReadOnlyReplicationHelperCLI 18 December 2014, 23:25:47 UTC
43495a8 Delete Keys CLI Add a tool Delete Keys CLI. This tool reads from a keyfile and deletes the key from the supplied stores. The tools are considered to be in human readable format and conversion will be attempted to the appropriate key. First of all understand that The tool also supports the following options 1) --delete-all-versions. If you have more than one value with conflicting versions, the tool will fail, because it may not have the value schema to de-serialize the value and resolve the conflict. The conflict resolution needs to happen before the key is deleted. 2) --nodeid <> --admin-url <>. If you want to delete keys only from a particular node. Use the above options. It is useful when you delete the keys and if a node went down, you want to rerun the tool with that option. 3) --find-keys-exist <> . After the delete you can run with this option to find if any of the keys exist. If the keys are found the tool dumps the version of each of the keys. The tool waits for the number of keys from each store before it completes. 18 December 2014, 02:31:25 UTC
ece26e2 Refactor the traffic generator Refactored the traffic generator into its own class. 18 December 2014, 02:31:25 UTC
c371265 Move slop drain function to server test utils Moved the slop drain function to server test utils. 18 December 2014, 02:31:25 UTC
884b93f Reformat ReadOnlyReplicationHelperCLI output 17 December 2014, 01:01:08 UTC
65de00c Add column names to the info printed by the tool 15 December 2014, 20:57:39 UTC
789a395 Productionize ReadOnlyReplicationHelper - Rename ReadOnlyHostSwapCLI -> REadOnlyReplicationHelper - Create unit test to verify the correctness - Change input from Cluster to BootstrapUrl to fit admin environment - Fix bugs and re-format help menu 13 December 2014, 00:36:09 UTC
6fe2142 RO tool that tells (1)source fileName(2)source node(3)fileName at destination This is important for RO host swap where SRE's need to find out where to copy the from and what to name it on the destination node 13 December 2014, 00:36:09 UTC
5e84a61 create admin api to return read-only storage file list 13 December 2014, 00:36:09 UTC
a920bda Releasing Voldemort 1.9.4 09 December 2014, 01:54:03 UTC
e236910 Refactor Client Traffic Verifier into its own class Refactored the client traffic verifier into its own class. No code change is done. This is just moving code into a new seperate class file and renaming the instantiation and references. Other refactorings will follow this checkin. 09 December 2014, 01:40:30 UTC
f691f67 Rename StoreVerifier to ConnectionVerifier 09 December 2014, 00:16:58 UTC
d2d1f35 Create separate failure detector for slop pusher 09 December 2014, 00:16:23 UTC
9e63cd7 Fix proximity list on 2 zone config Fix the proximity list on 2 zone config 26 November 2014, 00:33:32 UTC
2350ec4 Voldemort release 1.9.3 Release voldemort version 1.9.3 25 November 2014, 19:47:22 UTC
216bc4b Merge branch 'hostswap' 25 November 2014, 19:30:29 UTC
ec2fd87 ReplaceNodeCLI command The checkin adds a command to replace node. It takes in the old cluster URL and node id to be replaced and the new cluster URL. It modifies the old cluster to remove the old node and adds the new node in place. It automatically restores the data from the other nodes in the old cluster to the new node. 22 November 2014, 01:11:33 UTC
d92829d Correct ancient line & other things in Readme 12 November 2014, 18:28:03 UTC
7157bd1 add set-offline admin command in meta set 06 November 2014, 23:16:07 UTC
adef031 add ro-fetch switch and unit test 05 November 2014, 18:54:49 UTC
20dc5a1 add streaming switch in metadata store 05 November 2014, 18:54:49 UTC
63b5569 separate online services from all voldemort services 05 November 2014, 18:54:49 UTC
33adddf add admin request handler and admin command for offline state 05 November 2014, 18:54:48 UTC
981773b add OFFLINE_SERVER state 05 November 2014, 18:54:48 UTC
f52dced fix error messages in admin client 16 October 2014, 20:24:32 UTC
fa7e402 add log tracing info in failure detector 09 October 2014, 22:20:09 UTC
d9fceb0 Reverted changes to use again the lib folder Fixed bug not creating the lib folder in the assemble and jar gradle tasks 07 October 2014, 20:58:41 UTC
f8c5200 Releasing Voldemort 1.9.2 07 October 2014, 18:26:38 UTC
73bb270 Fix temp directory creation in Coordinator tests 07 October 2014, 17:38:20 UTC
eb96565 Minor fixes in Coordinator related tests 07 October 2014, 01:51:15 UTC
56241c4 explain 3 lib directories Explained the purpose of private,public and lib directory See the commit for more details. This is comment only no code change. 04 October 2014, 20:36:36 UTC
ff7f3e3 Releasing Voldemort 1.9.1 03 October 2014, 22:38:57 UTC
583a7bd Merge pull request #221 from voldemort/coadmin Coadmin 03 October 2014, 20:55:03 UTC
0d5a96d Merge branch 'coadmin' of https://github.com/voldemort/voldemort into coadmin 03 October 2014, 00:26:12 UTC
5d604a1 Addressed comments about the Coordinator Admin code, and fixed tests. 03 October 2014, 00:25:37 UTC
bf2309c fix fatclient config files 02 October 2014, 22:04:58 UTC
5ae570f addressed comments 02 October 2014, 19:53:03 UTC
0da292d slops are not pushed when cluster state changes Slop pusher caches the cluster state from the server startup. When the cluster state changes it is not refreshed. When the node is marked down because of failures, since the failure detector does not know about these new nodes, it never polls them back for availability. The node is permanently marked down, until the server reboots in which case the cluster is refreshed. Added a way to run integration tests from gradle, but they are still not part of any junit, junitAll or other tests. 02 October 2014, 00:16:38 UTC
0ec00a1 Merge branch 'coadmin' of github.com:voldemort/voldemort into coadmin 01 October 2014, 00:31:37 UTC
b6d6fa1 fix unit test for coord-admin-client and coord-admin-tool 01 October 2014, 00:31:01 UTC
babfd90 Adding comments to CoordinatorProxyService 01 October 2014, 00:25:36 UTC
d0c8187 Adding Listener for store client config changes * CoordinatorProxyService registers a listener when starting up * FileBasedStoreClientConfigService invokes listener methods to reinitialize fat client factories on inserts/updates of store client configs 30 September 2014, 21:33:09 UTC
ee56721 fix coordinator rest request origin time 30 September 2014, 00:35:17 UTC
527bf86 Merge pull request #217 from holbech/patch-1 _close_socket in _reconnect unusable at current location 29 September 2014, 14:22:54 UTC
58610ca Format: replace TAB with SPACE. 28 September 2014, 06:11:37 UTC
5a371e6 * Refactoring the CoordinatorProxyService initialize fat clients methods * Fixing StoreClientConfigService and refactoring FileBasedStoreClientConfigService * Fixing Coordinator unit tests 27 September 2014, 01:20:30 UTC
a3f45df Merge pull request #220 from kevinballard/fix-shell Fix getmetadata shell command 26 September 2014, 23:55:27 UTC
ec23bb2 Fix getmetadata shell command The "getmetadata" command cannot be run because the "get" command is shadowing it. 26 September 2014, 22:20:35 UTC
5fea9ae Fixed gradle execution in Windows Fixed script classpath Updated windows batch files 25 September 2014, 21:39:40 UTC
feb13cc WIP for the runtime update of coordinator fat clients 23 September 2014, 21:15:00 UTC
36016bc Merge branch 'coadmin' of https://github.com/voldemort/voldemort into coadmin 23 September 2014, 00:18:13 UTC
130e8dd get, put and delete coordinator admin commands affect the config file but don't yet change the runtime. 23 September 2014, 00:17:42 UTC
c81abea create coord-admin-tool-test 22 September 2014, 23:52:11 UTC
0d5dd51 Releasing Voldemort 1.9.0 22 September 2014, 18:34:55 UTC
aaa31e1 create coord-admin.sh 19 September 2014, 23:36:29 UTC
238e588 Fixing the query-key in the new admin tool I made the fix to the old tool incorrectly. Ported the code to the new tool with no modification. Talked to Xu and merging this directly Also added a minor fix to the unit tests which fails sometimes because of error. Added some retries and ignoring the failure. 19 September 2014, 19:04:52 UTC
4f04240 add store-update command in new admin tool 19 September 2014, 01:30:06 UTC
6f63a3e Merge branch coadmin of github.com:voldemort/voldemort into cshaxu/coadmin 19 September 2014, 00:25:47 UTC
1992acf create unit test for coord-admin-client 19 September 2014, 00:20:40 UTC
d43d736 Coordinator Admin supports specific GETs Also gives out error messages when a requested store does not exist. 18 September 2014, 01:37:27 UTC
f046352 Cleanup query keys output of Admin tool 1) Previously when the value bytes can't be deserialized it errored out immediately and it does not print values of other nodes. You can do node by node, but failed nodes can never be retrieved. Now if it fails, byte array output will be printed. 2) When node does not have a key, it printed invalid metadata exceptions for all other nodes. Now they are skipped in the output. 3) Does not report what all nodes had same value and which ones differed. 17 September 2014, 18:33:15 UTC
d34c946 Adding comments to illustrate a problem No code change. 17 September 2014, 01:42:05 UTC
fb18c79 2 zone configs 17 September 2014, 01:39:41 UTC
a569a2a Merge branch 'coadmin' of github.com:voldemort/voldemort into coadmin 16 September 2014, 01:13:52 UTC
fc8a3c8 some fix on admin client 16 September 2014, 01:13:45 UTC
912e2e7 More progress on the remote coordinator admin capabilities. GET all configs now works. 16 September 2014, 01:09:33 UTC
d62f503 Work in progress of the server-side Coordinator admin work. 12 September 2014, 00:54:56 UTC
8358888 Merge branch 'coadmin' of https://github.com/voldemort/voldemort into coordinator_admin Conflicts: src/java/voldemort/rest/coordinator/CoordinatorProxyService.java src/java/voldemort/rest/coordinator/admin/CoordinatorAdminRequestHandler.java 11 September 2014, 00:10:11 UTC
c5995a7 create coordinator-admin-client 10 September 2014, 21:18:28 UTC
c2e9181 create coord-admin-tool 10 September 2014, 21:18:28 UTC
f4d4e03 Remove unneeded code and add add TODO for send response 10 September 2014, 21:18:28 UTC
back to top