368f2c4 | Eric Tschetter | 19 March 2010, 22:45:29 UTC | No longer hard-coding HDFS replication factor. HDFS replication factor was set equal to Voldemort replication factor. This doesn't bring benefit (you can't ensure the HDFS fetcher jobs use distinct data nodes), could cause potential issues, can be done done without hard-coding (by setting it as a parameter when running the M/R job). | 22 March 2010, 23:15:43 UTC |
d96839b | Alex Feinberg | 22 March 2010, 23:08:46 UTC | Updated release notes, set curr.release to 0.80.1 | 22 March 2010, 23:15:21 UTC |
2c8b75e | Alex Feinberg | 18 March 2010, 21:47:35 UTC | Marking this a release candidate. | 18 March 2010, 21:47:35 UTC |
7c6f7b4 | Alex Feinberg | 18 March 2010, 17:55:03 UTC | Bumped up the version to 0.80.1. | 18 March 2010, 17:55:03 UTC |
d687031 | Michael Lambert | 02 March 2010, 16:59:14 UTC | Added configurable keep-alive option for socket connections. Solves problem where long standing idle tcp connections between clients and servers are covertly closed by intermediary firewalls. | 18 March 2010, 00:41:18 UTC |
49a078e | Alex Feinberg | 16 March 2010, 23:36:33 UTC | Improve AsyncOperationTest. | 16 March 2010, 23:36:33 UTC |
d07b2cd | Alex Feinberg | 16 March 2010, 20:43:58 UTC | Merge branch 'master' of github.com:voldemort/voldemort | 16 March 2010, 20:43:58 UTC |
fc1e97e | Kirk True | 16 March 2010, 17:57:01 UTC | Clean up of the StoreVerifier to make it more obvious that it's verifying based on the remote metadata store. Cleans the code up a bit. Also relaxed serialization on the ClientStoreVerifier so that the actual get call occurs outside of the synchronized block. Alas, it should make no difference as there's only one thread performing verification ;) | 16 March 2010, 17:57:01 UTC |
0d47e4f | Kirk True | 16 March 2010, 17:46:06 UTC | Issue 228: Improve threshold failure detector logging when node marked as unavailable due to exceeding request timeouts Clean up of the logging to output a message detailing that the timeouts have been exceeded when marking the node as unavailable. Also cleaned up the logging to only output the node ID instead of the node ID *and* all of its partitions (which, in a production system is very verbose). | 16 March 2010, 17:46:06 UTC |
68ae308 | Kirk True | 16 March 2010, 17:29:00 UTC | Issue 229: IllegalArgumentException using nio Replicating the assertion in position(int newPosition) in our code so as to print a better error message in order to help debug. | 16 March 2010, 17:29:00 UTC |
dedf249 | Alex Feinberg | 16 March 2010, 16:54:53 UTC | Cleaned-up Gossiper, re-factored GossiperTest to not generate spurious exceptions. | 16 March 2010, 16:54:53 UTC |
d6bd230 | Alex Feinberg | 13 March 2010, 03:33:38 UTC | Reduced synchronization scope in AdminServiceRequestHandler#addStore() | 16 March 2010, 05:59:46 UTC |
20bd3a9 | Bruce Ritchie | 11 March 2010, 01:40:42 UTC | Fixed issue 230: AdminClient#addStore could fail under concurrent load Synchronized store addition so concurrent editting/saving of configuration data doesn't occur: ConfigurationStorageEngine does not support that. | 16 March 2010, 05:59:45 UTC |
f49223d | Alex Feinberg | 15 March 2010, 09:18:23 UTC | Improved AdminTool, RebalanceUtils. * Added a shell script to invoke AdminTool. * AdminTool: no longer require store name. * RebalanceUtils: change RebalanceUtils.propagateCluster to allow propagation to *some* of nodes in a cluster, vs. all nodes in a cluster. | 16 March 2010, 05:54:56 UTC |
d6d487d | Alex Feinberg | 15 March 2010, 03:34:22 UTC | Re-organized administrative tools. | 16 March 2010, 05:54:56 UTC |
c4c6e30 | Alex Feinberg | 26 February 2010, 18:36:47 UTC | Created a command line interface to AdminClient. Added support for restore from replication. | 16 March 2010, 05:54:52 UTC |
59459b2 | Alex Feinberg | 16 March 2010, 01:15:51 UTC | Merge branch 'benchmark-tool' | 16 March 2010, 01:15:51 UTC |
b4811d1 | Alex Feinberg | 16 March 2010, 01:05:15 UTC | Switched to System.nanoTime(). | 16 March 2010, 01:05:15 UTC |
7285b7e | Kirk True | 16 March 2010, 00:31:45 UTC | Made some last-minute changes based on a dorked up push from my branch. | 16 March 2010, 00:31:45 UTC |
49d748f | Kirk True | 15 March 2010, 23:13:12 UTC | Simulate caching requests, collect percentiles for request times. * Reissuing requests to stimulate caching on the server. Wrap the core KeyProvider in an implementation that pulls out previously issued key and reuse an entry from that set randomly. * Collect request times and store them in an array that is used to collect percentiles. Didn't add it to the "m" case as I'm not sure if that makes any sense. | 15 March 2010, 23:23:57 UTC |
3663436 | Kirk True | 15 March 2010, 23:23:43 UTC | Removed TODO for changing default implementation. | 15 March 2010, 23:23:43 UTC |
51e6ab0 | Alex Feinberg | 08 March 2010, 21:28:53 UTC | Improved documentation in RemoteTest. | 15 March 2010, 23:18:52 UTC |
a9cc472 | Alex Feinberg | 04 March 2010, 23:41:44 UTC | No longer using admin client to get the store definition. | 15 March 2010, 23:18:52 UTC |
6f976ae | Alex Feinberg | 25 February 2010, 02:07:08 UTC | More graceful handling of nulls. | 15 March 2010, 23:18:52 UTC |
d6aaa74 | Alex Feinberg | 24 February 2010, 23:55:13 UTC | Added support for sending requests only to a specific node. - Created a tool to filter a request file for requests destined *only* for a specific node. - Added a -node option to RemoteTest to bootstrap only from a specified node rather than go to node 0 of the cluster. | 15 March 2010, 23:18:52 UTC |
a6bfba3 | Alex Feinberg | 24 February 2010, 04:47:28 UTC | Minor reporting corrections, fix race conditions for writes. | 15 March 2010, 23:18:52 UTC |
0eb5fcc | Alex Feinberg | 23 February 2010, 23:35:04 UTC | Printing statistics on an interval, mixing read/write requests. | 15 March 2010, 23:18:51 UTC |
1e42238 | Alex Feinberg | 23 February 2010, 08:48:09 UTC | First pass at refactoring RemoteTest for flexible key types instead of assuming String. | 15 March 2010, 23:18:51 UTC |
a220b22 | Alex Feinberg | 23 February 2010, 04:53:51 UTC | Simple improvements for RemoteTest: verbose mode, ignore nulls, don't count exceptions as succesful for throughput counts. | 15 March 2010, 23:18:51 UTC |
fb6438e | Kirk True | 15 March 2010, 23:06:11 UTC | Implemented the ability for the server-side routing based StoreVerifier to create metadata store based nodes on the fly. Also added a new unit test to ensure this. | 15 March 2010, 23:06:11 UTC |
e5da83b | Alex Feinberg | 15 March 2010, 20:44:23 UTC | Fixed a failing unit test in AsyncOperationTest. | 15 March 2010, 20:44:23 UTC |
eb9c4f9 | Alex Feinberg | 15 March 2010, 17:32:23 UTC | Merged the cleaned-up asynchronous operation service. | 15 March 2010, 17:32:23 UTC |
5c596e6 | Alex Feinberg | 13 March 2010, 06:47:29 UTC | Cleaned up the asynchronous operation service. Renamed AsyncOperationRunner to AsyncOperationService. Cleaned up AsyncOperationRepository. Renamed AsyncOperationRepository to AsyncOperationCache. | 13 March 2010, 06:47:30 UTC |
98fc368 | Alex Feinberg | 13 March 2010, 04:23:24 UTC | Renamed AsyncOperationRunner to AsyncOperationService. | 13 March 2010, 04:23:24 UTC |
149eb6d | Alex Feinberg | 09 March 2010, 00:56:30 UTC | Merge remote branch 'origin/master' | 09 March 2010, 00:56:30 UTC |
33b5e93 | Chris Riccomini | 08 March 2010, 22:47:30 UTC | Fixes for serialization (Hadoop, Json) and read only utils. - Default Serializer Factory now supports unversioned JsonTypeSerializers when store schema definition is "none". - Allow abstract store builder to use serializer factories other than Default Serializer Factory. - Fix read only utils to never return negative chunk numbers, even if Integer.MIN_VALUE is the key. | 09 March 2010, 00:55:01 UTC |
63890e5 | Ismael Juma | 06 March 2010, 11:36:40 UTC | Fix Issue 198: NoSuchElementException in ReadRepairer We clone the versions before doing read repair in the background. | 09 March 2010, 00:36:10 UTC |
b9b3001 | Alex Feinberg | 08 March 2010, 21:40:49 UTC | Merge remote branch 'ijuma/issue198' | 08 March 2010, 21:40:49 UTC |
68bfff1 | Alex Feinberg | 08 March 2010, 21:40:08 UTC | Merge remote branch 'trunk/master' | 08 March 2010, 21:40:08 UTC |
aa93540 | Alex Feinberg | 08 March 2010, 21:39:50 UTC | Revert "Issue 198: NoSuchElementException in ReadRepair." This reverts commit 533bb80fbba9ded4814862af6d3327eec9393bdb. | 08 March 2010, 21:39:50 UTC |
9db25db | Ismael Juma | 07 March 2010, 09:26:11 UTC | Make version final. | 07 March 2010, 09:26:11 UTC |
08e5168 | Ismael Juma | 07 March 2010, 09:25:55 UTC | Use a modified Avro library compiled with JDK5. The changes were: - Comment out some @Override annotations - Replace Arrays.copyOf calls with System.arraycopy - Remove FloatHistogram, Histogram, StatsPlugin and StatsServlet. This is not ideal (particularly the last line), but it will have to do for now as Histogram uses TreeMap.floorEntry which does not exist in JDK5. People on JDK6 should use the offiical Avro 1.3.0 jar instead. | 07 March 2010, 09:25:55 UTC |
41e1c17 | Ismael Juma | 06 March 2010, 11:36:40 UTC | Fix Issue 198: NoSuchElementException in ReadRepairer We clone the versions before doing read repair in the background. | 06 March 2010, 11:36:40 UTC |
f748dd9 | Ismael Juma | 06 March 2010, 09:27:00 UTC | Merge remote branch 'temoto/readme-fix' * temoto/readme-fix: fix README markup and few typo errors | 06 March 2010, 09:27:00 UTC |
e7c10f3 | Ismael Juma | 06 March 2010, 08:58:50 UTC | Add copyright notice to AvroUtils. | 06 March 2010, 08:58:50 UTC |
740e7db | Ismael Juma | 06 March 2010, 08:58:18 UTC | Remove @author. | 06 March 2010, 08:58:18 UTC |
4358a85 | Ismael Juma | 06 March 2010, 08:54:20 UTC | Introduce a type parameter representing the Java class in AvroReflectiveSerializer. Also fix an issue where AvroSpecificSerializer was being tested instead of AvroReflectiveSerializer in AvroReflectiveSerializerTest. | 06 March 2010, 08:55:45 UTC |
64389b7 | Ismael Juma | 06 March 2010, 08:47:41 UTC | Make AvroSpecificSerializer take a T extends SpecificRecord type parameter. This follows the pattern used by ProtoBufSerializer. | 06 March 2010, 08:55:45 UTC |
806c9e0 | Ismael Juma | 06 March 2010, 08:34:10 UTC | Extract AvroUtils.close to reduce duplication and make code easier to read. Also remove explicit calls to flush as this happens during close (and output.toByteArray does not throw exceptions). | 06 March 2010, 08:55:32 UTC |
7aceb83 | Ismael Juma | 06 March 2010, 08:22:34 UTC | Use DataFileStream instead of DataFileReader and remove SeekableByteArrayInput. The latter becomes unnecessary after the former change. | 06 March 2010, 08:27:36 UTC |
01baa4a | Ismael Juma | 06 March 2010, 08:17:39 UTC | Change close to take a Closeable instead of InputStream. | 06 March 2010, 08:17:39 UTC |
8ff3e04 | Ismael Juma | 06 March 2010, 08:02:22 UTC | Flesh out javadoc for Avro serializers and include links. | 06 March 2010, 08:02:22 UTC |
4046ed9 | Ismael Juma | 06 March 2010, 07:42:52 UTC | Remove comment regarding stress-testing once Avro 1.3 is out. Avro 1.3 is already out. | 06 March 2010, 07:42:52 UTC |
d70a0c0 | Ismael Juma | 06 March 2010, 07:39:05 UTC | Add Avro, Jackson and ParaNamer to NOTICE. | 06 March 2010, 07:39:05 UTC |
63e280c | Ismael Juma | 06 March 2010, 07:32:11 UTC | Add Antoine Toulme to CONTRIBUTORS file and remove @author tags from avro tests. | 06 March 2010, 07:32:11 UTC |
0a3be48 | Ismael Juma | 06 March 2010, 07:28:21 UTC | Remove sourcepath in .classpath that points to user-specific directory. | 06 March 2010, 07:28:21 UTC |
3e2c9de | Ismael Juma | 06 March 2010, 07:27:21 UTC | Merge remote branch 'atoulme/master' * atoulme/master: Issue 133: Avro contribution Conflicts: .classpath src/java/voldemort/serialization/DefaultSerializerFactory.java | 06 March 2010, 07:27:21 UTC |
533bb80 | Alex Feinberg | 04 March 2010, 02:24:29 UTC | Issue 198: NoSuchElementException in ReadRepair. RoutedStore#put() originally modified the version of a Versioned object in place. However, the same Version is also used a key in Multimap in ReadRepairer#singleKeyGetRepairs(). This change creates an incremented copy of the Version, which is then set in the Versioned object (which has been modified with a setVersion method). | 06 March 2010, 00:09:32 UTC |
4a8c400 | Alex Feinberg | 01 March 2010, 18:05:41 UTC | Changed NodeValue#equals to look at version of the value. NodeValue#hashCode looks at nodeId, key and value (aka getNodeId(), getKey() and getVersioned()). HashCode and equals must work the same. Calculating hashCode/equals based on Version rather than value. Added a unit test for NodeValue (to check hashCode/equals). | 06 March 2010, 00:09:31 UTC |
b28a629 | Alex Feinberg | 05 March 2010, 20:56:41 UTC | Changing default failure detector request length threshold to socket time out length. This disables the behaviour where by slow (but succesful) requests are not considered successes by the failure detector. While this may be a good behaviour to enable in production (depending on the SLA, capacity and many other factor), by default users don't want to see nodes detected as failed (especially if this results in InsufficientOperationalNodes exceptions) if these nodes are still able to answer requests. These settings should also be documented as first-class pages on the site (rather than in the wiki). In addition, when a node is marked down due to being slow, this should be clearly indicated in the default-level logs. | 06 March 2010, 00:02:58 UTC |
f019092 | Antoine Toulme | 10 February 2010, 07:48:08 UTC | Issue 133: Avro contribution | 04 March 2010, 02:43:21 UTC |
d0745ee | Sergey Shepelev | 03 March 2010, 19:28:33 UTC | fix README markup and few typo errors | 03 March 2010, 19:28:33 UTC |
e219ac6 | Kirk True | 01 March 2010, 04:53:23 UTC | Issue 223: changed default for client to use ThresholdFailureDetector and added a comment to VoldemortConfig regarding need to change to default when issue 197 is resolved. | 01 March 2010, 04:53:23 UTC |
4fa61a9 | Kirk True | 01 March 2010, 04:17:33 UTC | Merge remote branch 'upstream/master' into issue-222 | 01 March 2010, 04:17:33 UTC |
6af5d2f | Kirk True | 01 March 2010, 03:43:55 UTC | Removed the @author tags from Java source files. | 01 March 2010, 03:43:55 UTC |
50a6ecc | Kirk True | 01 March 2010, 03:19:54 UTC | Issue 81: adding CONTRIBUTORS file. | 01 March 2010, 03:19:54 UTC |
2c7ae45 | Kirk True | 01 March 2010, 03:15:16 UTC | Updates to remove the maps from the SocketResourceFactory and embed the timestamps in the SocketAndStreams and SocketDestination objects. | 01 March 2010, 03:15:16 UTC |
4f40ea2 | Kirk True | 27 February 2010, 06:13:08 UTC | Fix for issue 222. Revised KeyedResourcePool.close(K key) to fix leaking sockets. Instead of removing the pool itself, we close it. Closing a pool clears all idle resources in the pool at the time of closure. Additionally, the SocketPool sets a timestamp for the SocketDestination object that notes when it was last closed. We also set a timestamp for each Socket that notes when it was created. The validate method of SocketResourceFactory now checks these two timestamps and deems invalid any sockets created prior to the pool closing. Only those sockets created before the closure will be auto-closed on returning to the pool; new sockets will not be closed. | 27 February 2010, 06:13:08 UTC |
b4a202a | Alex Feinberg | 22 February 2010, 18:36:57 UTC | Fix for a potential issue: exception in AsyncOperation never re-thrown. | 22 February 2010, 18:36:57 UTC |
ed24894 | Alex Feinberg | 19 February 2010, 03:27:34 UTC | Merge branch 'release-080' | 19 February 2010, 03:27:34 UTC |
b3683e1 | Alex Feinberg | 19 February 2010, 02:29:03 UTC | Switched version to 0.80 | 19 February 2010, 02:29:03 UTC |
17f3624 | Alex Feinberg | 19 February 2010, 01:47:47 UTC | Updated release notes. | 19 February 2010, 01:47:47 UTC |
33ede20 | Alex Feinberg | 17 February 2010, 23:13:00 UTC | Incorporated a patch from Bhupesh fixing Issue 210. | 18 February 2010, 03:49:45 UTC |
89cadb4 | Alex Feinberg | 18 February 2010, 03:33:22 UTC | Merge branch 'master' of github.com:afeinberg/voldemort | 18 February 2010, 03:33:22 UTC |
6ff946e | Alex Feinberg | 17 February 2010, 23:13:00 UTC | Incorporated a patch from Bhupesh fixing Issue 210. | 18 February 2010, 03:31:42 UTC |
d2c8824 | Alex Feinberg | 17 February 2010, 23:13:00 UTC | Incoprorating patch from Bhupesh fixing issue 210. | 17 February 2010, 23:13:00 UTC |
27b5df8 | Alex Feinberg | 17 February 2010, 01:18:46 UTC | Fixed a backwards compatibility issue in the client protocol. | 17 February 2010, 02:23:48 UTC |
2743817 | Alex Feinberg | 17 February 2010, 01:18:46 UTC | Fixed a backwards compatibility issue in the client protocol. | 17 February 2010, 01:18:46 UTC |
5a26383 | Alex Feinberg | 15 February 2010, 21:10:37 UTC | Merge remote branch 'trunk/master' | 15 February 2010, 21:10:37 UTC |
4b99e67 | Kirk True | 15 February 2010, 18:01:13 UTC | Fixed some oversights in use of System.currentTimeMillis() vs. System.nanoTime() for FailureDetector as found by Ismael. | 15 February 2010, 21:10:09 UTC |
9aff7ef | Alex Feinberg | 15 February 2010, 21:09:04 UTC | Merge branch 'release-080' of github.com:afeinberg/voldemort into release-080 | 15 February 2010, 21:09:04 UTC |
b3b7b43 | Alex Feinberg | 15 February 2010, 19:39:19 UTC | Bumped up the version to 0.80.RC1 | 15 February 2010, 21:08:09 UTC |
139b4c0 | Alex Feinberg | 15 February 2010, 19:43:53 UTC | Using socket instead of admin port to bootstrap. | 15 February 2010, 21:07:46 UTC |
7890cc8 | Alex Feinberg | 15 February 2010, 19:43:53 UTC | Using socket instead of admin port to bootstrap. | 15 February 2010, 19:43:53 UTC |
9365e16 | Kirk True | 15 February 2010, 19:43:39 UTC | Merge remote branch 'upstream/master' into availability | 15 February 2010, 19:43:39 UTC |
7355a99 | Alex Feinberg | 15 February 2010, 19:39:19 UTC | Bumped up the version to 0.80.RC1 | 15 February 2010, 19:39:19 UTC |
0516af2 | Kirk True | 15 February 2010, 18:01:13 UTC | Fixed some oversights in use of System.currentTimeMillis() vs. System.nanoTime() for FailureDetector as found by Ismael. | 15 February 2010, 18:01:13 UTC |
5755cdf | Alex Feinberg | 15 February 2010, 08:44:45 UTC | Fixed Javadoc for EndToEndTest. | 15 February 2010, 08:44:45 UTC |
2c7d0d4 | Alex Feinberg | 15 February 2010, 08:26:14 UTC | Created an unmocked test for basic functionality. | 15 February 2010, 08:26:58 UTC |
d5c7442 | Alex Feinberg | 14 February 2010, 18:19:22 UTC | Throttling on all disk activity. | 14 February 2010, 18:19:22 UTC |
e62c9ec | Kirk True | 13 February 2010, 00:33:37 UTC | Merge remote branch 'upstream/master' into nio-server2-cleanup | 13 February 2010, 00:33:37 UTC |
d5ea5a5 | Kirk True | 12 February 2010, 22:53:00 UTC | Fix for issue 207 (FailureDetector.recordSuccess could take startTime instead or in addition to requestTime). Changing the API required a lot of changes. Instead I just changed the two users of the class to use nanoseconds instead and refactored into separate private methods in each class which makes it cleaner in general. | 12 February 2010, 22:53:00 UTC |
c2edaaa | Kirk True | 12 February 2010, 22:20:55 UTC | Forcing the number of selectors to be at least 8 if not explicitly provided. | 12 February 2010, 22:20:55 UTC |
3a1c02f | Kirk True | 12 February 2010, 22:04:32 UTC | Separated out the "normal" NIO selector count from the "admin service" NIO selector count as the latter may tend to need to be bigger on account of the long-lived requests. | 12 February 2010, 22:04:32 UTC |
c499c66 | Kirk True | 12 February 2010, 21:42:31 UTC | Merge remote branch 'upstream/master' into nio-server2-cleanup | 12 February 2010, 21:42:31 UTC |
6817957 | Alex Feinberg | 10 February 2010, 23:03:38 UTC | Javadoc updates. | 10 February 2010, 23:03:38 UTC |
f14fd18 | Alex Feinberg | 10 February 2010, 22:39:28 UTC | Documented ClientConfig#setMaxBoostrapRetries(int) | 10 February 2010, 22:39:28 UTC |
1092190 | Alex Feinberg | 10 February 2010, 22:35:14 UTC | Minor javadoc fixes. | 10 February 2010, 22:35:14 UTC |
daa286e | Kirk True | 09 February 2010, 20:23:01 UTC | Merge remote branch 'upstream/master' into nio-server2-cleanup Conflicts: src/java/voldemort/server/protocol/admin/AdminServiceRequestHandler.java test/integration/voldemort/socketpool/SimpleSocketPoolTest.java test/unit/voldemort/client/AdminServiceBasicTest.java test/unit/voldemort/client/AdminServiceFailureTest.java | 09 February 2010, 20:23:01 UTC |
54c90fa | Kirk True | 09 February 2010, 20:01:15 UTC | Added comments, implementing StreamRequestDirection. | 09 February 2010, 20:01:15 UTC |