538903e | Siddharth Singh | 12 July 2013, 23:00:42 UTC | Add license info | 14 August 2013, 23:39:58 UTC |
8102340 | Siddharth Singh | 09 July 2013, 23:27:36 UTC | RebalanceController Scheduler + Unit Test | 14 August 2013, 23:39:57 UTC |
9362a4b | Chinmay Soman | 07 August 2013, 22:05:23 UTC | Revert "Changing vector clock serialization to base64 instead of json to improve performance" This was part of performance benchmarking. It got wrong pushed to this branch. This reverts commit fe8479365d8f1eca8f34a09817caa93ed7437dcd. | 07 August 2013, 22:10:33 UTC |
3759eba | Chinmay Soman | 07 August 2013, 21:30:59 UTC | Changing vector clock serialization to base64 instead of json to improve performance | 07 August 2013, 22:10:33 UTC |
9ebeb60 | Chinmay Soman | 30 July 2013, 01:21:06 UTC | Restructuring the Voldemort REST server and Coordinator under a common package: voldemort.rest | 07 August 2013, 22:10:33 UTC |
6c7d221 | Chinmay Soman | 26 July 2013, 21:48:21 UTC | Refactoring Coordinator to use standard Netty pipeline which is more scalable than the previous FatClientWrapper design | 07 August 2013, 22:10:33 UTC |
4543d28 | Chinmay Soman | 25 July 2013, 18:56:22 UTC | First pass of refactoring Coordinator Netty pipeline: using common thread pool instead of isolating | 07 August 2013, 22:10:33 UTC |
e1fdd63 | Zhongjie Wu | 31 July 2013, 01:29:12 UTC | remove toggle for using pipeline routed store or not | 31 July 2013, 01:29:12 UTC |
b60e24c | Zhongjie Wu | 24 July 2013, 21:32:15 UTC | added zone affinity get versions | 31 July 2013, 00:29:14 UTC |
867afed | Zhongjie Wu | 17 July 2013, 23:08:10 UTC | refactor zone-affinity-getall after review | 31 July 2013, 00:29:14 UTC |
431d69c | Zhongjie Wu | 16 July 2013, 20:08:14 UTC | first implementation of zone-affinity-getall | 31 July 2013, 00:29:14 UTC |
90fe0ce | Zhongjie Wu | 15 July 2013, 21:36:00 UTC | Updated zoneAffinityGet implementation after code review 1. Instantiate ZoneAffinity object inside clientConfig 2. Instantiate ZoneAffinity object in PipelineRoutedStore's constructor if null pointer is passed in 3. Use three zone cluster in ZoneAffinityGetTest and make client in each of the three zones in three test | 31 July 2013, 00:29:14 UTC |
0f0d0b4 | Zhongjie Wu | 11 July 2013, 23:11:50 UTC | Added support for GET zoneAffinity 1. Added config options in clientConfig parser 2. Added ZoneAffinity Class 3. Added reference of ZoneAffinity Class in RoutedStoreConfig 4. Added GET ZoneAffinity support in PipelineRoutedStore | 31 July 2013, 00:29:14 UTC |
fbfbf8e | Zhongjie Wu | 08 July 2013, 19:09:50 UTC | added a test for zone affinity get | 31 July 2013, 00:29:14 UTC |
41cf6a7 | Zhongjie Wu | 08 July 2013, 19:09:31 UTC | fixed a bug that throws exceptions for some tests | 31 July 2013, 00:29:14 UTC |
1520f50 | Zhongjie Wu | 11 July 2013, 00:16:47 UTC | more refactorings on RoutedStore | 31 July 2013, 00:29:14 UTC |
b603a60 | Zhongjie Wu | 02 July 2013, 22:51:48 UTC | Refactor pipeline routed store and its factory 1. Force using pipelineRoutedStore for routedStore 2. Deprecated threadPoolBased routedStore | 31 July 2013, 00:29:14 UTC |
d80b48d | Bhavani Sudha Saktheeswaran | 25 July 2013, 00:28:16 UTC | - Renaming connectionStats and ConnectionStatsHandler classes - Processing code review comments for the commit 4bdae66753d1dd8ee5de52563fda206e038cf19f - removed tracking for getversion | 25 July 2013, 18:04:19 UTC |
fc95530 | Bhavani Sudha Saktheeswaran | 24 July 2013, 00:32:38 UTC | adding zone id for computing server side latencies - Zone id is an optional header in the REST request - if the request is from same zone, the server side latencies are recorded adding logic to filter expired requests | 25 July 2013, 18:04:19 UTC |
f97a263 | Bhavani Sudha Saktheeswaran | 19 July 2013, 20:11:42 UTC | processing code review comments for the commit https://github.com/bhasudha/voldemort/commit/5d3da0cda97351e62e91f35756fc6ab9ab23f22d | 24 July 2013, 18:40:47 UTC |
8c0bec0 | Bhavani Sudha Saktheeswaran | 18 July 2013, 20:52:08 UTC | Adding monitoring hooks - Mbeans for active connections to the Rest service - Mbeans for Netty worker pool stats - Mbeans for Storage Thread Pool threads and queue size | 24 July 2013, 18:40:47 UTC |
7da7d38 | Abhinay Nagpal | 24 July 2013, 18:32:50 UTC | changing release number in properties file | 24 July 2013, 18:32:50 UTC |
7ed180d | Abhinay Nagpal | 24 July 2013, 18:10:29 UTC | Checking in release notes | 24 July 2013, 18:10:29 UTC |
8e2bdfd | Abhinay Nagpal | 16 July 2013, 22:53:46 UTC | Use HintedHandoff to route the key instead of dupliating code | 19 July 2013, 22:49:09 UTC |
878eb87 | Abhinay Nagpal | 16 July 2013, 21:54:28 UTC | Refactoring based on review feedback Major changes: renamed: src/java/voldemort/client/protocol/admin/StreamingClient.java -> src/java/voldemort/client/protocol/admin/BaseStreamingClient.java renamed: src/java/voldemort/client/protocol/admin/SlopWrappingStreamingClient.java -> src/java/voldemort/client/protocol/admin/StreamingClient.java | 19 July 2013, 22:49:09 UTC |
c2bd069 | Abhinay Nagpal | 12 July 2013, 23:32:33 UTC | Added functionality to stream slops. SlopWrappingStreamingClient is a wrapper around the StreamingClient which expects a set of faultynodes and streams Slops for those nodes Added integration tests to test this functionality see: SlopStreamingTest | 19 July 2013, 22:49:09 UTC |
2722222 | Abhinay Nagpal | 03 July 2013, 18:15:38 UTC | Initial skeleton of highly available streaming client that registers slops | 19 July 2013, 22:48:36 UTC |
90c62c9 | Bhavani Sudha Saktheeswaran | 17 July 2013, 18:34:22 UTC | - Added config parameter for enabling Rest Service. Rest Service will run on port 8085 but will not be enabled by default. Set rest.enable=true to bring up RestService. - Bringing back HttpService on it port 8081. - Changing the Rest Service unit tests to use port 8085 | 18 July 2013, 00:00:06 UTC |
c16ca1f | Bhavani Sudha Saktheeswaran | 10 July 2013, 20:21:19 UTC | Changing get version - get version will be a HTTP GET request with a special header "X-VOLD-Get-Version" with non null value - get version response body will containg the vector clock(s) - deleting RestServerGtVersionRequestValidator.java - RestServerGetRequestValidator will handle get, getall and getversion operations added non negative checks to timestamp and timeout headers | 18 July 2013, 00:00:06 UTC |
1019ecb | Chinmay Soman | 16 July 2013, 21:36:42 UTC | Cleaned up the copyright messages. Renamed SystemStore to SystemStoreClient to avoid ambiguities | 16 July 2013, 21:36:42 UTC |
b7f2b96 | Chinmay Soman | 16 July 2013, 20:49:09 UTC | Cleaned up the creation of system stores. Created a SystemStoreClientFactory to handle this | 16 July 2013, 20:49:09 UTC |
9142525 | Chinmay Soman | 16 July 2013, 06:14:11 UTC | Moving SocketStoreClientFactory creation from SystemStore to SystemStoreRepository. This prevents leaking of sockets during re-bootstrap | 16 July 2013, 06:14:11 UTC |
f826906 | Bhavani Sudha Saktheeswaran | 09 July 2013, 22:38:57 UTC | moving RestSpecAndBasicUnitTest to test/unit/voldemort/server/rest | 09 July 2013, 22:38:57 UTC |
da9b8b0 | Bhavani Sudha Saktheeswaran | 09 July 2013, 20:56:52 UTC | updating R2Store and RestServerAPITest to push into voldemort/master | 09 July 2013, 20:56:52 UTC |
e43637d | Bhavani Sudha Saktheeswaran | 09 July 2013, 02:04:46 UTC | Minor fixes post code review. Amending for few missing files in previous commit. - Adding new config for REST Server and reverting changes to the single_node_cluster/config - Adding a new constructor for R2Store to pass RoutingTypeCode as a constructor parameter - Renaming Rest service config parameters in VoldemortConfig - Adding logger.error for all error messages | 09 July 2013, 20:11:23 UTC |
db7fe2c | Bhavani Sudha Saktheeswaran | 09 July 2013, 01:44:32 UTC | Minor fixes post code review - Adding new config for REST Server and reverting changes to the single_node_cluster/config - Adding a new constructor for R2Store to pass RoutingTypeCode as a constructor parameter - Renaming Rest service config parameters in VoldemortConfig - Adding logger.error for all error messages minor fixes post code# On branch master | 09 July 2013, 20:08:25 UTC |
1810666 | Bhavani Sudha Saktheeswaran | 03 July 2013, 23:10:55 UTC | Adding unit tests - RestServerProtocolTests : protcol tests that validate spec using HttpURLConnection to send requests - RestServerAPITest : basic API test using R2Store to send requests | 09 July 2013, 20:08:25 UTC |
589d89a | Bhavani Sudha Saktheeswaran | 03 July 2013, 22:54:53 UTC | Modified parsing and error handling mechanism - split RestServerDeleteRequestErrorHandler into two classes. 1) RestServerDeleteErrorHandler and 2) RestServerDeleteRequestValidator Repeated this for all other operations Added config parameter specific to the Rest Server - number of netty boss threads - number of netty worker threads - numer of storage threads in the Rest Server storage thread pool - queue size in the Rest server storage thread pool - modified RestService, RestPipelineFactory to incorporate config param changes Added methods in CoordinatorUtils to serialize and deserialze multiple vectorCLocks Added origin timestamp and routing type headers to R2Store Added Execution handler to Netty pipelinne - submits time consuming channel events to disk access to a seprate thread pool - StorageWorkerThread defines thread in the storage threadpool - VoldemortStoreRequest is the message event passed from VoldemortRestRequestHandler and StorageExecutionHandler | 09 July 2013, 20:08:25 UTC |
8c75420 | Bhavani Sudha Saktheeswaran | 25 June 2013, 05:24:10 UTC | Minor changes in message headers and handling non existing keys. Also adding curl tests. - Fixed message headers in multipart responses - Changed ETag response headers to X-VOLD-Vector-Clock - Handled non exisitng or null keys. Sent error message to Client - Added curl test cases that test REST spec and basic functionalities | 09 July 2013, 19:54:07 UTC |
3bb0f17 | Bhavani Sudha Saktheeswaran | 24 June 2013, 18:59:52 UTC | Fixing get version | 09 July 2013, 19:54:07 UTC |
48c56c9 | Bhavani Sudha Saktheeswaran | 15 June 2013, 20:39:14 UTC | Initial commit for Rest-Netty Voldemort Server - Implemented a rest specification for handling get, put, getall, delete - Uses InMemory Store for now - Tests coming soon | 09 July 2013, 19:54:07 UTC |
92eaef3 | Chinmay Soman | 09 July 2013, 19:39:29 UTC | More cleanup of R2Store - made Routing code optional in the HTTP header | 09 July 2013, 19:39:29 UTC |
f1cadda | Chinmay Soman | 09 July 2013, 06:00:43 UTC | Cleaned up R2Store and created RESTClientFactory along with RESTClientConfig | 09 July 2013, 06:07:18 UTC |
3ac868d | Chinmay Soman | 01 July 2013, 19:03:22 UTC | R2Store cleanup and added the multipart and nested multipart handlers in R2Store | 09 July 2013, 06:07:18 UTC |
86e2603 | Siddharth Singh | 08 July 2013, 23:08:10 UTC | Fix NPE in the test code Pass an empty list instead of a null. | 08 July 2013, 23:38:08 UTC |
758e5f1 | Chinmay Soman | 08 July 2013, 19:17:05 UTC | Preparing release 1.4.4 with rebalancing improvements | 08 July 2013, 19:17:05 UTC |
607c635 | Siddharth Singh | 04 July 2013, 00:29:55 UTC | Copy analysis file to output_dir | 04 July 2013, 00:42:57 UTC |
299bb61 | Siddharth Singh | 03 July 2013, 22:54:34 UTC | Rename new cluster script | 04 July 2013, 00:42:57 UTC |
ba68c0a | Siddharth Singh | 03 July 2013, 19:29:32 UTC | More cleanup to repartitioner Fix varible names, typos add comments | 04 July 2013, 00:42:57 UTC |
a3e970e | Siddharth Singh | 03 July 2013, 17:26:04 UTC | Make repartitioner interface consistent + cleanup | 04 July 2013, 00:42:57 UTC |
8beef25 | Siddharth Singh | 01 July 2013, 21:56:26 UTC | Expose max contiguous partitons option to script | 04 July 2013, 00:42:57 UTC |
db82fea | Siddharth Singh | 01 July 2013, 18:11:32 UTC | Cleanup minor typos and comments | 04 July 2013, 00:42:57 UTC |
cb938a0 | Siddharth Singh | 01 July 2013, 20:06:32 UTC | Copy plan outout to the final directory | 04 July 2013, 00:42:57 UTC |
4532c11 | Siddharth Singh | 29 June 2013, 00:51:13 UTC | Remove vold_home parameter from scripts These scripts are being shipped as part of vold repo and so no need for this extra parameter. | 04 July 2013, 00:42:57 UTC |
ff2ce09 | Siddharth Singh | 29 June 2013, 00:01:56 UTC | Get rid of tee-ing the plan to a separate file The rebalance planner writes the output to a file named plan.out so this is not needed anymore. | 04 July 2013, 00:42:57 UTC |
0485420 | Siddharth Singh | 28 June 2013, 23:54:55 UTC | Fix comments | 04 July 2013, 00:42:57 UTC |
2b2a6f7 | Siddharth Singh | 28 June 2013, 23:51:48 UTC | Add cluster expansion script | 04 July 2013, 00:42:57 UTC |
1dc317d | Siddharth Singh | 28 June 2013, 22:42:34 UTC | Fix location of example stores | 04 July 2013, 00:42:57 UTC |
c1a3be7 | Siddharth Singh | 28 June 2013, 22:24:24 UTC | Add rebalance shuffle script | 04 July 2013, 00:42:57 UTC |
79844e5 | Jay J Wylie | 01 July 2013, 19:45:26 UTC | Change Repartioner to swap among nodes from all specified zones. PartitionBalance - Added comment about possible weakness of our utility method. Repartitoiner.java - Changed random shuffle implementation to swap among all nodes in specified zones. - Left TODOs and 'dead code' implemntation of intra-zone swapping vs inter-zone swapping. | 04 July 2013, 00:42:57 UTC |
98a0beb | Siddharth Singh | 28 June 2013, 21:01:05 UTC | Avoid potential null pointer deref of config | 03 July 2013, 20:55:43 UTC |
854a99a | Jay J Wylie | 03 July 2013, 17:45:45 UTC | Added pending release notes. | 03 July 2013, 17:45:45 UTC |
1ffaa5d | Jay J Wylie | 03 July 2013, 17:13:36 UTC | Address minor code review feedback - cleaned up TODOs and comments - added TODO to incorporate Abhinays work on "metadata listener" | 03 July 2013, 17:14:19 UTC |
f69def2 | Jay J Wylie | 02 July 2013, 20:44:38 UTC | Fast construction of BaseStoreRoutingPlan objects Cleaned up code that was quickly hacked to ensure BaseStoreRoutingPlan objects are "fast" to construct. In this clean up, managed to make construction constant time (sub-microsecond on my workstation). Basically, the struct that had been expensive to construct already existed in the Cluster object and its reference could simply be copied. Cluster.java - renamed "numberOfTags" to "numberOfPartitionIds" - replaced map with array for partitoinIdToNode lookups BaseStoreRoutingPlan - TODOs and comments ConsistentRoutingStrategy - simply copy the partitionIdToNode lookup from cluster object StoreRoutingPlan - Pre-compute the mapping of partition Id to replicating list - TODOs and comments test/integration/voldemort/performance/StoreRoutingPlanPerf.java - performance test of various cluster/storedef combos: - BaseStoreRoutingPlan (fast to construct!) - StoreRoutingPlan (slow to construct, but faster than it had been) - PartitionBalance (slow to construct, but faster than it had been) | 03 July 2013, 17:14:19 UTC |
a7205d8 | Siddharth Singh | 28 June 2013, 00:55:41 UTC | Get rid of Integer reference comparison The current code does Integer reference comparisons. When possible int primitive type should be used. | 01 July 2013, 17:33:47 UTC |
4a95638 | Vinoth Chandar | 28 June 2013, 07:20:34 UTC | Update release_notes and build.properties for 1.4.2 release | 28 June 2013, 07:20:34 UTC |
5459942 | Jay J Wylie | 28 June 2013, 01:41:55 UTC | Making StoreRoutingPlan even lighter-weight | 28 June 2013, 04:43:12 UTC |
bf7daad | Jay J Wylie | 28 June 2013, 01:27:02 UTC | Adding BaseStoreRoutingPlan. | 28 June 2013, 04:43:12 UTC |
606f6fa | Jay J Wylie | 28 June 2013, 01:25:44 UTC | Refactor StoreRoutingPlan. Break Base from rest to expedite construction. | 28 June 2013, 04:43:12 UTC |
f8765a3 | Jay J Wylie | 25 June 2013, 16:37:13 UTC | Addressed review feedback on rebalance scheduler RebalanceController - Changed default parallelism to "infinite" since scheduler throttles parallelism - Added TODOs for cleanup of scheduler - Added javadoc to document scheduler and its methods - Catch exceptions, log them, re-throw as VoldemmortRebalancingException A ton of white space changes due to futzing with eclipse code formatter preferences. Sorry. | 28 June 2013, 04:43:12 UTC |
d7356df | Jay J Wylie | 24 June 2013, 15:47:07 UTC | Tweak new rebalance scheduler Randomized the order of rebalance tasks in each stealer's list. This will avoid biasing the rebalance based on the order tasks were generated. | 28 June 2013, 04:43:12 UTC |
34e849e | Jay J Wylie | 23 June 2013, 23:04:00 UTC | Initial hack at new rebalance scheduler. Added RebalanceController.scheduler - limits each node to participating in a single task as either a stealer or donor. - randomizes the order in which tasks are attempted to be scheduled - not a clean implementation, but enough to evaluate. | 28 June 2013, 04:43:12 UTC |
a26a558 | Jay J Wylie | 23 June 2013, 16:11:25 UTC | Tweaks to PartitionBalance and RebalancePlan PartitionBalance - calculate partition-stores per zone. - This measure provides more context to evaluate the size of any plans to rebalance the cluster. RebalancePlanCLI - fix typo in verbose usage message | 28 June 2013, 04:43:12 UTC |
33ea454 | Zhongjie Wu | 24 June 2013, 19:59:11 UTC | bug fixes in coordinator | 24 June 2013, 23:51:34 UTC |
93b9495 | Siddharth Singh | 21 June 2013, 19:41:49 UTC | Bump release version | 21 June 2013, 19:41:49 UTC |
4d72ef4 | Siddharth Singh | 21 June 2013, 19:35:16 UTC | Add 1.3.4 and 1.4.0 release notes | 21 June 2013, 19:35:16 UTC |
155b934 | Siddharth Singh | 19 June 2013, 00:17:53 UTC | Fix comments and typos | 21 June 2013, 15:48:56 UTC |
3d8eb81 | Siddharth Singh | 19 June 2013, 00:15:40 UTC | Add separate dummy stores for 2 and 3 zone cluster | 21 June 2013, 15:48:47 UTC |
3944a3c | Siddharth Singh | 19 June 2013, 00:15:11 UTC | Cleanup the arguments and add sanity check | 21 June 2013, 15:48:39 UTC |
5d1e8e3 | Siddharth Singh | 18 June 2013, 01:00:07 UTC | Step 2: Add logic to handle zoned clusters | 21 June 2013, 15:48:29 UTC |
d2452a9 | Siddharth Singh | 15 June 2013, 01:19:57 UTC | Step 1 : Generate cluster script cleanup | 21 June 2013, 15:48:14 UTC |
882c01f | Jay J Wylie | 20 June 2013, 22:33:40 UTC | Fix RebalanceUtils.getLatestCluster. RebalanceUtils - changed getLatestCluster to examine contents of cluster.xml on different nodes rather than timestamps since timestamps are incomparable across servers. AbstractZonedRebalanceTest - added a specific rebalance test that goes from current -> shuffle and then shuffle -> current. This confirms that rebalance can be invoked repeated times (if need be). | 20 June 2013, 23:11:05 UTC |
0c8f0fa | Abhinay Nagpal | 13 June 2013, 23:22:51 UTC | Fixed systemstore constants and got rid of the superfluous zone rep factor | 20 June 2013, 23:11:05 UTC |
a758c2a | Abhinay Nagpal | 13 June 2013, 21:49:19 UTC | Tests for system store with a 3 zone cluster | 20 June 2013, 23:11:05 UTC |
3512cff | Vinoth Chandar | 14 June 2013, 00:35:07 UTC | Modifying RoutedStoreTest to use Consistent Strategy | 20 June 2013, 23:11:05 UTC |
9a90156 | Abhinay Nagpal | 13 June 2013, 17:58:27 UTC | Addressed code review comments added more assertions check for getZoneNary and getNodeIdForZoneNary in zone 1 and 2 Added a test for method 'storeRoutingPlan.zoneNAryExists() | 20 June 2013, 23:09:23 UTC |
4f135d5 | Abhinay Nagpal | 12 June 2013, 20:38:24 UTC | Test for 3 zones | 20 June 2013, 23:09:23 UTC |
d2848a1 | Siddharth Singh | 12 June 2013, 21:51:14 UTC | Add dummy-stores.xml + Update the path in script | 20 June 2013, 23:09:23 UTC |
803d7dd | Siddharth Singh | 12 June 2013, 21:45:15 UTC | Move rebalance scripts to bin directory Moving the script from top level to the bin directory | 20 June 2013, 23:09:23 UTC |
1807fae | Siddharth Singh | 12 June 2013, 21:23:49 UTC | Copy final cluster xml file to output dir When the final cluster.xml is generated it is placed in outputdir/step3 folder. Copy it to outputdir as well. | 20 June 2013, 23:09:23 UTC |
f9936c1 | Siddharth Singh | 12 June 2013, 03:53:08 UTC | Add rebalance new cluster script | 20 June 2013, 23:09:23 UTC |
9d9b47e | Siddharth Singh | 11 June 2013, 22:30:56 UTC | Address code review comments | 20 June 2013, 23:09:23 UTC |
407d4e4 | Siddharth Singh | 10 June 2013, 23:47:07 UTC | Edit script to use the new option | 20 June 2013, 23:09:22 UTC |
ba371fc | Siddharth Singh | 10 June 2013, 23:42:46 UTC | Add an option for choosing zone id for shuffle Add a new option that lets the user choose if they want the shuffle to operate only on one of the zone ids. | 20 June 2013, 23:09:22 UTC |
c1fb3aa | Siddharth Singh | 10 June 2013, 20:03:21 UTC | Add zone expansion script | 20 June 2013, 23:09:22 UTC |
aa96bbf | Siddharth Singh | 07 June 2013, 22:18:05 UTC | Write plan to a file inside the output dir | 20 June 2013, 23:09:22 UTC |
9ee4ebe | Siddharth Singh | 03 June 2013, 23:27:10 UTC | Print the utility value | 20 June 2013, 23:09:22 UTC |
f55aace | Jay J Wylie | 07 June 2013, 21:23:36 UTC | Fix final-cluster to be required arg of RebalancePlanCLI | 20 June 2013, 23:09:22 UTC |
77f3b69 | Jay J Wylie | 06 June 2013, 20:54:24 UTC | Correctly print RebalanceTask at creation time. | 20 June 2013, 23:09:22 UTC |
ec9cd1e | Jay J Wylie | 04 June 2013, 16:58:29 UTC | Minor fix to KeyVersionFetcherCLI | 20 June 2013, 23:09:22 UTC |