https://github.com/voldemort/voldemort

sort by:
Revision Author Date Message Commit Date
538903e Add license info 14 August 2013, 23:39:58 UTC
8102340 RebalanceController Scheduler + Unit Test 14 August 2013, 23:39:57 UTC
9362a4b Revert "Changing vector clock serialization to base64 instead of json to improve performance" This was part of performance benchmarking. It got wrong pushed to this branch. This reverts commit fe8479365d8f1eca8f34a09817caa93ed7437dcd. 07 August 2013, 22:10:33 UTC
3759eba Changing vector clock serialization to base64 instead of json to improve performance 07 August 2013, 22:10:33 UTC
9ebeb60 Restructuring the Voldemort REST server and Coordinator under a common package: voldemort.rest 07 August 2013, 22:10:33 UTC
6c7d221 Refactoring Coordinator to use standard Netty pipeline which is more scalable than the previous FatClientWrapper design 07 August 2013, 22:10:33 UTC
4543d28 First pass of refactoring Coordinator Netty pipeline: using common thread pool instead of isolating 07 August 2013, 22:10:33 UTC
e1fdd63 remove toggle for using pipeline routed store or not 31 July 2013, 01:29:12 UTC
b60e24c added zone affinity get versions 31 July 2013, 00:29:14 UTC
867afed refactor zone-affinity-getall after review 31 July 2013, 00:29:14 UTC
431d69c first implementation of zone-affinity-getall 31 July 2013, 00:29:14 UTC
90fe0ce Updated zoneAffinityGet implementation after code review 1. Instantiate ZoneAffinity object inside clientConfig 2. Instantiate ZoneAffinity object in PipelineRoutedStore's constructor if null pointer is passed in 3. Use three zone cluster in ZoneAffinityGetTest and make client in each of the three zones in three test 31 July 2013, 00:29:14 UTC
0f0d0b4 Added support for GET zoneAffinity 1. Added config options in clientConfig parser 2. Added ZoneAffinity Class 3. Added reference of ZoneAffinity Class in RoutedStoreConfig 4. Added GET ZoneAffinity support in PipelineRoutedStore 31 July 2013, 00:29:14 UTC
fbfbf8e added a test for zone affinity get 31 July 2013, 00:29:14 UTC
41cf6a7 fixed a bug that throws exceptions for some tests 31 July 2013, 00:29:14 UTC
1520f50 more refactorings on RoutedStore 31 July 2013, 00:29:14 UTC
b603a60 Refactor pipeline routed store and its factory 1. Force using pipelineRoutedStore for routedStore 2. Deprecated threadPoolBased routedStore 31 July 2013, 00:29:14 UTC
d80b48d - Renaming connectionStats and ConnectionStatsHandler classes - Processing code review comments for the commit 4bdae66753d1dd8ee5de52563fda206e038cf19f - removed tracking for getversion 25 July 2013, 18:04:19 UTC
fc95530 adding zone id for computing server side latencies - Zone id is an optional header in the REST request - if the request is from same zone, the server side latencies are recorded adding logic to filter expired requests 25 July 2013, 18:04:19 UTC
f97a263 processing code review comments for the commit https://github.com/bhasudha/voldemort/commit/5d3da0cda97351e62e91f35756fc6ab9ab23f22d 24 July 2013, 18:40:47 UTC
8c0bec0 Adding monitoring hooks - Mbeans for active connections to the Rest service - Mbeans for Netty worker pool stats - Mbeans for Storage Thread Pool threads and queue size 24 July 2013, 18:40:47 UTC
7da7d38 changing release number in properties file 24 July 2013, 18:32:50 UTC
7ed180d Checking in release notes 24 July 2013, 18:10:29 UTC
8e2bdfd Use HintedHandoff to route the key instead of dupliating code 19 July 2013, 22:49:09 UTC
878eb87 Refactoring based on review feedback Major changes: renamed: src/java/voldemort/client/protocol/admin/StreamingClient.java -> src/java/voldemort/client/protocol/admin/BaseStreamingClient.java renamed: src/java/voldemort/client/protocol/admin/SlopWrappingStreamingClient.java -> src/java/voldemort/client/protocol/admin/StreamingClient.java 19 July 2013, 22:49:09 UTC
c2bd069 Added functionality to stream slops. SlopWrappingStreamingClient is a wrapper around the StreamingClient which expects a set of faultynodes and streams Slops for those nodes Added integration tests to test this functionality see: SlopStreamingTest 19 July 2013, 22:49:09 UTC
2722222 Initial skeleton of highly available streaming client that registers slops 19 July 2013, 22:48:36 UTC
90c62c9 - Added config parameter for enabling Rest Service. Rest Service will run on port 8085 but will not be enabled by default. Set rest.enable=true to bring up RestService. - Bringing back HttpService on it port 8081. - Changing the Rest Service unit tests to use port 8085 18 July 2013, 00:00:06 UTC
c16ca1f Changing get version - get version will be a HTTP GET request with a special header "X-VOLD-Get-Version" with non null value - get version response body will containg the vector clock(s) - deleting RestServerGtVersionRequestValidator.java - RestServerGetRequestValidator will handle get, getall and getversion operations added non negative checks to timestamp and timeout headers 18 July 2013, 00:00:06 UTC
1019ecb Cleaned up the copyright messages. Renamed SystemStore to SystemStoreClient to avoid ambiguities 16 July 2013, 21:36:42 UTC
b7f2b96 Cleaned up the creation of system stores. Created a SystemStoreClientFactory to handle this 16 July 2013, 20:49:09 UTC
9142525 Moving SocketStoreClientFactory creation from SystemStore to SystemStoreRepository. This prevents leaking of sockets during re-bootstrap 16 July 2013, 06:14:11 UTC
f826906 moving RestSpecAndBasicUnitTest to test/unit/voldemort/server/rest 09 July 2013, 22:38:57 UTC
da9b8b0 updating R2Store and RestServerAPITest to push into voldemort/master 09 July 2013, 20:56:52 UTC
e43637d Minor fixes post code review. Amending for few missing files in previous commit. - Adding new config for REST Server and reverting changes to the single_node_cluster/config - Adding a new constructor for R2Store to pass RoutingTypeCode as a constructor parameter - Renaming Rest service config parameters in VoldemortConfig - Adding logger.error for all error messages 09 July 2013, 20:11:23 UTC
db7fe2c Minor fixes post code review - Adding new config for REST Server and reverting changes to the single_node_cluster/config - Adding a new constructor for R2Store to pass RoutingTypeCode as a constructor parameter - Renaming Rest service config parameters in VoldemortConfig - Adding logger.error for all error messages minor fixes post code# On branch master 09 July 2013, 20:08:25 UTC
1810666 Adding unit tests - RestServerProtocolTests : protcol tests that validate spec using HttpURLConnection to send requests - RestServerAPITest : basic API test using R2Store to send requests 09 July 2013, 20:08:25 UTC
589d89a Modified parsing and error handling mechanism - split RestServerDeleteRequestErrorHandler into two classes. 1) RestServerDeleteErrorHandler and 2) RestServerDeleteRequestValidator Repeated this for all other operations Added config parameter specific to the Rest Server - number of netty boss threads - number of netty worker threads - numer of storage threads in the Rest Server storage thread pool - queue size in the Rest server storage thread pool - modified RestService, RestPipelineFactory to incorporate config param changes Added methods in CoordinatorUtils to serialize and deserialze multiple vectorCLocks Added origin timestamp and routing type headers to R2Store Added Execution handler to Netty pipelinne - submits time consuming channel events to disk access to a seprate thread pool - StorageWorkerThread defines thread in the storage threadpool - VoldemortStoreRequest is the message event passed from VoldemortRestRequestHandler and StorageExecutionHandler 09 July 2013, 20:08:25 UTC
8c75420 Minor changes in message headers and handling non existing keys. Also adding curl tests. - Fixed message headers in multipart responses - Changed ETag response headers to X-VOLD-Vector-Clock - Handled non exisitng or null keys. Sent error message to Client - Added curl test cases that test REST spec and basic functionalities 09 July 2013, 19:54:07 UTC
3bb0f17 Fixing get version 09 July 2013, 19:54:07 UTC
48c56c9 Initial commit for Rest-Netty Voldemort Server - Implemented a rest specification for handling get, put, getall, delete - Uses InMemory Store for now - Tests coming soon 09 July 2013, 19:54:07 UTC
92eaef3 More cleanup of R2Store - made Routing code optional in the HTTP header 09 July 2013, 19:39:29 UTC
f1cadda Cleaned up R2Store and created RESTClientFactory along with RESTClientConfig 09 July 2013, 06:07:18 UTC
3ac868d R2Store cleanup and added the multipart and nested multipart handlers in R2Store 09 July 2013, 06:07:18 UTC
86e2603 Fix NPE in the test code Pass an empty list instead of a null. 08 July 2013, 23:38:08 UTC
758e5f1 Preparing release 1.4.4 with rebalancing improvements 08 July 2013, 19:17:05 UTC
607c635 Copy analysis file to output_dir 04 July 2013, 00:42:57 UTC
299bb61 Rename new cluster script 04 July 2013, 00:42:57 UTC
ba68c0a More cleanup to repartitioner Fix varible names, typos add comments 04 July 2013, 00:42:57 UTC
a3e970e Make repartitioner interface consistent + cleanup 04 July 2013, 00:42:57 UTC
8beef25 Expose max contiguous partitons option to script 04 July 2013, 00:42:57 UTC
db82fea Cleanup minor typos and comments 04 July 2013, 00:42:57 UTC
cb938a0 Copy plan outout to the final directory 04 July 2013, 00:42:57 UTC
4532c11 Remove vold_home parameter from scripts These scripts are being shipped as part of vold repo and so no need for this extra parameter. 04 July 2013, 00:42:57 UTC
ff2ce09 Get rid of tee-ing the plan to a separate file The rebalance planner writes the output to a file named plan.out so this is not needed anymore. 04 July 2013, 00:42:57 UTC
0485420 Fix comments 04 July 2013, 00:42:57 UTC
2b2a6f7 Add cluster expansion script 04 July 2013, 00:42:57 UTC
1dc317d Fix location of example stores 04 July 2013, 00:42:57 UTC
c1a3be7 Add rebalance shuffle script 04 July 2013, 00:42:57 UTC
79844e5 Change Repartioner to swap among nodes from all specified zones. PartitionBalance - Added comment about possible weakness of our utility method. Repartitoiner.java - Changed random shuffle implementation to swap among all nodes in specified zones. - Left TODOs and 'dead code' implemntation of intra-zone swapping vs inter-zone swapping. 04 July 2013, 00:42:57 UTC
98a0beb Avoid potential null pointer deref of config 03 July 2013, 20:55:43 UTC
854a99a Added pending release notes. 03 July 2013, 17:45:45 UTC
1ffaa5d Address minor code review feedback - cleaned up TODOs and comments - added TODO to incorporate Abhinays work on "metadata listener" 03 July 2013, 17:14:19 UTC
f69def2 Fast construction of BaseStoreRoutingPlan objects Cleaned up code that was quickly hacked to ensure BaseStoreRoutingPlan objects are "fast" to construct. In this clean up, managed to make construction constant time (sub-microsecond on my workstation). Basically, the struct that had been expensive to construct already existed in the Cluster object and its reference could simply be copied. Cluster.java - renamed "numberOfTags" to "numberOfPartitionIds" - replaced map with array for partitoinIdToNode lookups BaseStoreRoutingPlan - TODOs and comments ConsistentRoutingStrategy - simply copy the partitionIdToNode lookup from cluster object StoreRoutingPlan - Pre-compute the mapping of partition Id to replicating list - TODOs and comments test/integration/voldemort/performance/StoreRoutingPlanPerf.java - performance test of various cluster/storedef combos: - BaseStoreRoutingPlan (fast to construct!) - StoreRoutingPlan (slow to construct, but faster than it had been) - PartitionBalance (slow to construct, but faster than it had been) 03 July 2013, 17:14:19 UTC
a7205d8 Get rid of Integer reference comparison The current code does Integer reference comparisons. When possible int primitive type should be used. 01 July 2013, 17:33:47 UTC
4a95638 Update release_notes and build.properties for 1.4.2 release 28 June 2013, 07:20:34 UTC
5459942 Making StoreRoutingPlan even lighter-weight 28 June 2013, 04:43:12 UTC
bf7daad Adding BaseStoreRoutingPlan. 28 June 2013, 04:43:12 UTC
606f6fa Refactor StoreRoutingPlan. Break Base from rest to expedite construction. 28 June 2013, 04:43:12 UTC
f8765a3 Addressed review feedback on rebalance scheduler RebalanceController - Changed default parallelism to "infinite" since scheduler throttles parallelism - Added TODOs for cleanup of scheduler - Added javadoc to document scheduler and its methods - Catch exceptions, log them, re-throw as VoldemmortRebalancingException A ton of white space changes due to futzing with eclipse code formatter preferences. Sorry. 28 June 2013, 04:43:12 UTC
d7356df Tweak new rebalance scheduler Randomized the order of rebalance tasks in each stealer's list. This will avoid biasing the rebalance based on the order tasks were generated. 28 June 2013, 04:43:12 UTC
34e849e Initial hack at new rebalance scheduler. Added RebalanceController.scheduler - limits each node to participating in a single task as either a stealer or donor. - randomizes the order in which tasks are attempted to be scheduled - not a clean implementation, but enough to evaluate. 28 June 2013, 04:43:12 UTC
a26a558 Tweaks to PartitionBalance and RebalancePlan PartitionBalance - calculate partition-stores per zone. - This measure provides more context to evaluate the size of any plans to rebalance the cluster. RebalancePlanCLI - fix typo in verbose usage message 28 June 2013, 04:43:12 UTC
33ea454 bug fixes in coordinator 24 June 2013, 23:51:34 UTC
93b9495 Bump release version 21 June 2013, 19:41:49 UTC
4d72ef4 Add 1.3.4 and 1.4.0 release notes 21 June 2013, 19:35:16 UTC
155b934 Fix comments and typos 21 June 2013, 15:48:56 UTC
3d8eb81 Add separate dummy stores for 2 and 3 zone cluster 21 June 2013, 15:48:47 UTC
3944a3c Cleanup the arguments and add sanity check 21 June 2013, 15:48:39 UTC
5d1e8e3 Step 2: Add logic to handle zoned clusters 21 June 2013, 15:48:29 UTC
d2452a9 Step 1 : Generate cluster script cleanup 21 June 2013, 15:48:14 UTC
882c01f Fix RebalanceUtils.getLatestCluster. RebalanceUtils - changed getLatestCluster to examine contents of cluster.xml on different nodes rather than timestamps since timestamps are incomparable across servers. AbstractZonedRebalanceTest - added a specific rebalance test that goes from current -> shuffle and then shuffle -> current. This confirms that rebalance can be invoked repeated times (if need be). 20 June 2013, 23:11:05 UTC
0c8f0fa Fixed systemstore constants and got rid of the superfluous zone rep factor 20 June 2013, 23:11:05 UTC
a758c2a Tests for system store with a 3 zone cluster 20 June 2013, 23:11:05 UTC
3512cff Modifying RoutedStoreTest to use Consistent Strategy 20 June 2013, 23:11:05 UTC
9a90156 Addressed code review comments added more assertions check for getZoneNary and getNodeIdForZoneNary in zone 1 and 2 Added a test for method 'storeRoutingPlan.zoneNAryExists() 20 June 2013, 23:09:23 UTC
4f135d5 Test for 3 zones 20 June 2013, 23:09:23 UTC
d2848a1 Add dummy-stores.xml + Update the path in script 20 June 2013, 23:09:23 UTC
803d7dd Move rebalance scripts to bin directory Moving the script from top level to the bin directory 20 June 2013, 23:09:23 UTC
1807fae Copy final cluster xml file to output dir When the final cluster.xml is generated it is placed in outputdir/step3 folder. Copy it to outputdir as well. 20 June 2013, 23:09:23 UTC
f9936c1 Add rebalance new cluster script 20 June 2013, 23:09:23 UTC
9d9b47e Address code review comments 20 June 2013, 23:09:23 UTC
407d4e4 Edit script to use the new option 20 June 2013, 23:09:22 UTC
ba371fc Add an option for choosing zone id for shuffle Add a new option that lets the user choose if they want the shuffle to operate only on one of the zone ids. 20 June 2013, 23:09:22 UTC
c1fb3aa Add zone expansion script 20 June 2013, 23:09:22 UTC
aa96bbf Write plan to a file inside the output dir 20 June 2013, 23:09:22 UTC
9ee4ebe Print the utility value 20 June 2013, 23:09:22 UTC
f55aace Fix final-cluster to be required arg of RebalancePlanCLI 20 June 2013, 23:09:22 UTC
77f3b69 Correctly print RebalanceTask at creation time. 20 June 2013, 23:09:22 UTC
ec9cd1e Minor fix to KeyVersionFetcherCLI 20 June 2013, 23:09:22 UTC
back to top