6c87093 | Vinoth Chandar | 15 January 2013, 00:14:02 UTC | Prepare to release version 1.1.8 | 15 January 2013, 00:14:02 UTC |
adc3eb9 | Vinoth Chandar | 15 January 2013, 00:05:01 UTC | Release notes & version update for 1.1.8 | 15 January 2013, 00:05:01 UTC |
2d12189 | Vinoth Chandar | 14 January 2013, 22:05:58 UTC | Fixing intermittent test failures | 14 January 2013, 22:06:52 UTC |
3b6c282 | Chinmay Soman | 14 January 2013, 02:52:29 UTC | Bug fixes in HdfsFetcher revealed by HdfsFetcherTest (NPE and hiding the VoldemortSerializationException) | 14 January 2013, 02:52:29 UTC |
f97699b | Vinoth Chandar | 12 January 2013, 00:25:55 UTC | Minor debug fixes | 12 January 2013, 00:25:55 UTC |
a18d91b | Chinmay Soman | 11 January 2013, 23:41:32 UTC | Fixing .classpath which had the wrong hadoop-core version. Also changed the Mlock related info messages to debug. | 11 January 2013, 23:43:00 UTC |
c611a8c | Chinmay Soman | 11 January 2013, 22:16:44 UTC | Updated the hadoop-core jar to 1.0.4-p2 | 11 January 2013, 23:42:06 UTC |
4f5ce5b | Chinmay Soman | 11 January 2013, 01:07:38 UTC | Added the ability to delete old checksum files in the Build and Push reducer. Also updated the hadoop core library to version 1.0.4-p2-rc2 containing the fix to the User ID command usage. | 11 January 2013, 23:42:06 UTC |
ec3b37e | Vinoth Chandar | 11 January 2013, 21:29:26 UTC | Improve batch modifications on BDB-JE | 11 January 2013, 23:36:41 UTC |
903e749 | Vinoth Chandar | 10 January 2013, 21:31:27 UTC | Monitoring for streaming operations | 11 January 2013, 23:36:41 UTC |
4ae1336 | Jay J Wylie | 10 January 2013, 16:28:34 UTC | Fix tests for testStartVoldemortCluster to not consume so much memory test/common/voldemort/ServerTestUtils.java - remove stress test from normal testing - test the method startVoldemortCluster once and confirm it returns a non-null Cluster object test/common/voldemort/ServerTestUtils.java - clarified a comment | 10 January 2013, 16:28:34 UTC |
db493a1 | Chinmay Soman | 04 January 2013, 00:09:05 UTC | Updated release_notes and release version to 1.1.7 including Kerberos related changes | 04 January 2013, 00:09:05 UTC |
5aa3716 | Vinoth Chandar | 02 January 2013, 21:32:35 UTC | NIO + BDB stats - Code review comments | 02 January 2013, 21:37:43 UTC |
dd29d0e | Vinoth Chandar | 18 December 2012, 00:13:57 UTC | Stats to understand NIO layer performance + BDB exception counts et al | 02 January 2013, 21:37:43 UTC |
fbe6718 | Chinmay Soman | 07 December 2012, 23:34:43 UTC | Creating constants for the default kerberos principal and keytab path | 07 December 2012, 23:34:43 UTC |
ef5420f | Chinmay Soman | 07 December 2012, 01:15:20 UTC | Removing the additional JVM args from the Voldemort scripts | 07 December 2012, 01:15:20 UTC |
7d93e6d | Chinmay Soman | 07 December 2012, 01:06:16 UTC | Adding KDC info and other JVM arguments to the voldemort scripts | 07 December 2012, 01:06:16 UTC |
e7b93ba | Chinmay Soman | 06 December 2012, 19:53:02 UTC | Adding a hack to bypass Kerberos authentication for hftp protocol. TODO: remove this bypass once the libhadoop on Solaris is well tested | 06 December 2012, 19:54:19 UTC |
22b99c3 | Chinmay Soman | 29 November 2012, 23:59:08 UTC | Finalized changes to HdfsFetcher to make it work with a Kerberized Hadoop cluster over webhdfs | 06 December 2012, 19:54:19 UTC |
44c4667 | Chinmay Soman | 11 October 2012, 21:45:05 UTC | Standardizing the Kerberos login phase : explicitly specify the Hadoop config and keytab path. Also assumes that extra kerberos related config parameters are passed to the Java process | 06 December 2012, 19:54:19 UTC |
577378e | Chinmay Soman | 06 September 2012, 20:52:13 UTC | Correcting usage: proxyUser to kerberosUser | 06 December 2012, 19:54:19 UTC |
2965762 | Chinmay Soman | 16 August 2012, 00:05:25 UTC | Fixing a bug where we dont need to have hadoop conf in the classpath | 06 December 2012, 19:54:19 UTC |
c8d7a6c | Chinmay Soman | 24 May 2012, 21:29:14 UTC | Fix in FsPermission constructor to maintain hadoop jar backwards compatibility | 06 December 2012, 19:54:19 UTC |
0f2f85e | Chinmay Soman | 23 May 2012, 23:59:14 UTC | Fixed a jmx unregister bug in hdfs fetcher | 06 December 2012, 19:54:19 UTC |
e6b24c6 | Chinmay Soman | 16 May 2012, 00:39:10 UTC | Doing authentication in a synchronized block for the Hdfs fetcher, setting correct permission for the hadoop files | 06 December 2012, 19:54:19 UTC |
7693d6b | Chinmay Soman | 14 May 2012, 22:24:06 UTC | Fixed the main method params in HdfsFetcher | 06 December 2012, 19:54:19 UTC |
c745f80 | Chinmay Soman | 14 May 2012, 21:27:10 UTC | Added configurable Kerberos support to HdfsFetcher and upgraded hadoop jars to 1.0.2 | 06 December 2012, 19:54:19 UTC |
daa49bf | Abhinay Nagpal | 06 December 2012, 19:12:57 UTC | Add support for kerberized grids in the job by supporting protocols | 06 December 2012, 19:12:57 UTC |
374d02a | Abhinay Nagpal | 29 November 2012, 22:43:43 UTC | Added release notes | 29 November 2012, 22:43:43 UTC |
99dc97f | Abhinay Nagpal | 29 November 2012, 21:53:17 UTC | Adding mlock for RO stores | 29 November 2012, 21:57:23 UTC |
7c49c64 | Abhinay Nagpal | 27 November 2012, 22:10:10 UTC | Fixed constructor to actually take the mlock parameter made it true by default | 29 November 2012, 21:57:23 UTC |
2f5e776 | Abhinay Nagpal | 27 November 2012, 21:44:54 UTC | Fixed bug with typesetting of the native args by wrapping it into a native wrapper | 29 November 2012, 21:57:23 UTC |
220c5f1 | Abhinay Nagpal | 26 November 2012, 23:46:16 UTC | debug msgs# Explicit paths specified without -i nor -o; assuming --only paths... | 29 November 2012, 21:57:23 UTC |
763ff89 | Abhinay Nagpal | 20 November 2012, 22:12:02 UTC | Hardcoding indexmlock to true | 29 November 2012, 21:57:23 UTC |
32fb76a | Abhinay Nagpal | 20 November 2012, 21:41:56 UTC | Code cleanup | 29 November 2012, 21:57:23 UTC |
4db8cc3 | Abhinay Nagpal | 19 November 2012, 19:25:42 UTC | Implemented a jna mlock to map and ping index files for RO stores in memory | 29 November 2012, 21:57:23 UTC |
349f852 | Abhinay Nagpal | 27 November 2012, 23:56:22 UTC | Changed release number | 27 November 2012, 23:56:22 UTC |
d56a614 | Abhinay Nagpal | 26 November 2012, 18:28:01 UTC | fixed avro mapper | 26 November 2012, 18:28:01 UTC |
60a987c | Abhinay Nagpal | 21 November 2012, 23:46:02 UTC | Fixed mapper issue | 21 November 2012, 23:46:02 UTC |
84eda3a | Jay J Wylie | 31 October 2012, 18:43:11 UTC | Prepared release 1.1.2 | 31 October 2012, 18:43:11 UTC |
ba8c6fb | Jay J Wylie | 31 October 2012, 17:52:09 UTC | Revert return type of Versioned.getVersion() to be Version rather than VectorClock | 31 October 2012, 17:52:09 UTC |
3c99c01 | Jay J Wylie | 30 October 2012, 15:34:36 UTC | Bumped curr.release to 1.1.1 | 30 October 2012, 15:34:36 UTC |
6246d4e | Jay J Wylie | 29 October 2012, 23:32:32 UTC | Fixes for connection leak and ZenStoreClient config - Applied fix for socketChannel leak in ClientRequestExecutorFactory.create() - Added comments to document other code paths at risk of leaking socketDestinations - changed ClientConfig default from ZenStoreClient to DefaultStoreClient - updated release notes | 29 October 2012, 23:32:32 UTC |
c227e34 | Vinoth Chandar | 19 October 2012, 19:10:48 UTC | Updating release notes and version | 19 October 2012, 19:10:48 UTC |
3f1ec39 | Vinoth Chandar | 19 October 2012, 04:13:49 UTC | Resolving Conflict: Adding Imports back in test | 19 October 2012, 04:13:49 UTC |
cd16456 | Vinoth Chandar | 02 October 2012, 22:05:37 UTC | Add RetentionEnforcingStore, with support for online retention on reads | 19 October 2012, 04:09:44 UTC |
08e5258 | Vinoth Chandar | 01 October 2012, 17:50:03 UTC | Added parameters to control retention job 1. day of the week the retention job starts 2. if the retention job starts at the same hour each day | 19 October 2012, 04:07:25 UTC |
3d51f85 | Vinoth Chandar | 19 October 2012, 03:56:09 UTC | Fixing SlowStorageEngine and FileBackedCachingStorageEngine build issues | 19 October 2012, 03:56:09 UTC |
5e48136 | Vinoth Chandar | 19 October 2012, 03:28:08 UTC | BDB data conversion utility | 19 October 2012, 03:50:44 UTC |
7c9e2b0 | Vinoth Chandar | 18 October 2012, 01:38:51 UTC | Add BDB params -- background_proactive_migration, level based eviction | 19 October 2012, 03:50:44 UTC |
68b31b9 | Vinoth Chandar | 10 October 2012, 20:13:29 UTC | Adding Partition Scan support for rebalancing | 19 October 2012, 03:50:44 UTC |
98182b6 | Vinoth Chandar | 24 September 2012, 19:09:35 UTC | Code review - partition scan | 19 October 2012, 03:50:44 UTC |
fbe56d2 | Vinoth Chandar | 15 September 2012, 00:22:03 UTC | Partition scans - more tests, typo fixes | 19 October 2012, 03:50:44 UTC |
4c1064e | Vinoth Chandar | 14 September 2012, 04:02:42 UTC | Implementing partition scans | 19 October 2012, 03:47:16 UTC |
07e509d | Vinoth Chandar | 31 August 2012, 19:51:20 UTC | Upgrading to JE 4.1.17 | 19 October 2012, 03:45:40 UTC |
0d449a7 | Vinoth Chandar | 02 August 2012, 00:40:52 UTC | Code review changes | 19 October 2012, 03:45:40 UTC |
692b63f | Vinoth Chandar | 27 July 2012, 02:53:58 UTC | initial commit - new duplicate handling | 19 October 2012, 03:42:51 UTC |
5a021db | Jay J Wylie | 18 October 2012, 14:59:42 UTC | Revised NOTE in the release_notes about version numbering. | 18 October 2012, 14:59:42 UTC |
922ec3a | Jay J Wylie | 17 October 2012, 22:47:43 UTC | Explained the versioning number change. | 17 October 2012, 22:47:43 UTC |
b6447a5 | Jay J Wylie | 17 October 2012, 22:36:48 UTC | Tweaked release notes | 17 October 2012, 22:36:48 UTC |
c6a6e21 | Jay J Wylie | 17 October 2012, 21:34:53 UTC | Bumped release to 1.0.0 and added release notes. | 17 October 2012, 21:34:53 UTC |
e1796c4 | Jay J Wylie | 17 October 2012, 15:41:29 UTC | Hardened junit long test RebalanceLongTest.java. Other test hardening. build.xml - bumped all maxmemory settings to 2048m - Placed a 90 minute timeout on the long test at ant level. test/long/voldemort/client/rebalance/RebalanceLongTest.java - null out some objects in the hopes of reducing the overall memory footprint of these tests. We are truly abusing junit with a long-running, multi-threaded test, that has 10 sub tests and 4 distinct parameter settings. test/unit/voldemort/client/rebalance/AbstractRebalanceTest.java - start of tests is not clear in junit log output. Added logger.info to start of tests to make grepping through the log when tests have failed badly and/or are running in an infitie loop easier. - Bumped each test timeout up to 10 minutes. Again, note abuse of junit: tests should not be defined at the abstract class level. This makes it hard to set appropriate limits (such as timeout) for each specific test. Long tests should have a different timeout than short tests... | 17 October 2012, 16:03:40 UTC |
34ab463 | Jay J Wylie | 15 October 2012, 19:05:25 UTC | Added two tools for repeatedly running junit tests. Either specific tests, or all of junit. The benefit of these scripts is that the results from each run are archived toa temp directory. This allows you to stress test big changes, find intermittent failures, and so on. | 16 October 2012, 21:34:09 UTC |
61c11c7 | Jay J Wylie | 15 October 2012, 14:55:31 UTC | Cleaned up comments and TODOs from prior commits. | 16 October 2012, 21:34:09 UTC |
2411377 | Jay J Wylie | 12 October 2012, 23:26:42 UTC | Fixed two small errors I introduced while fixing tests (or merging with master). | 16 October 2012, 21:34:08 UTC |
7d60d6f | Jay J Wylie | 12 October 2012, 21:25:45 UTC | updated copyrights on touched files. | 16 October 2012, 21:34:08 UTC |
7c793f6 | Jay J Wylie | 12 October 2012, 21:20:07 UTC | Additional hardening of tests to reduce the number of intermittent BindException errors due to a TOCTOU issue with getLocalCluster. test/integration/voldemort/performance/RoutedStoreParallelismTest.java - switched to startVoldemortCluster test/unit/voldemort/server/gossip/GossiperTest.java - hand-coded test-specific startParallelVoldemortCluster. Not pretty. Not pretty at all. But, should retry in the face of such exceptions. Switched TODO to comment about possible susceptability to BindExceptions: - test/unit/voldemort/client/rebalance/RebalanceTest.java - test/unit/voldemort/scheduled/StreamingSlopPusherTest.java | 16 October 2012, 21:34:08 UTC |
de66f98 | Jay J Wylie | 12 October 2012, 19:00:12 UTC | Hardening test utils and tests to reduce the number of intermittent BindException errors due to a TOCTOU issue with getLocalCluster. The main improvement is the addition of ServerTestUtils.startVoldemortCluster that wraps getLocalCluster and a bunch of startVoldemortServer calls in a retry loop based on wether a BindException occurs. This is suitable to ~75% of our test cases that use getLocalCluster. test/common/voldemort/ServerTestUtils.java - Added startVoldemortCluster test/unit/voldemort/utils/ServerTestUtilsTest.java - Tests for ServerTestUtils to reproduce intermittent failures src/java/voldemort/server/VoldemortServer.java - TODO note about method that plays a role in another intermittent test failure invovling cluster.xml Switched test to use startVoldemortCluster test/unit/voldemort/client/AdminServiceBasicTest.java test/unit/voldemort/client/rebalance/AdminRebalanceTest.java test/unit/voldemort/cluster/failuredetector/ServerStoreVerifierTest.java test/unit/voldemort/server/EndToEndTest.java test/unit/voldemort/server/socket/NioStatsJmxTest.java test/unit/voldemort/store/readonly/swapper/StoreSwapperTest.java test/unit/voldemort/store/rebalancing/RebootstrappingStoreTest.java test/unit/voldemort/versioning/ChainedInconsistencyResolverTest.java Junit3 -> Junit 4 test/unit/voldemort/client/AdminServiceBasicTest.java test/unit/voldemort/client/rebalance/AdminRebalanceTest.java test/unit/voldemort/server/gossip/GossiperTest.java test/unit/voldemort/server/socket/NioStatsJmxTest.java test/unit/voldemort/store/readonly/swapper/StoreSwapperTest.java test/unit/voldemort/versioning/ChainedInconsistencyResolverTest.java Annotated with a TODO about the test still needing to be hardened against TOCTOU issue with getLocalCluster: test/integration/voldemort/performance/RoutedStoreParallelismTest.java test/unit/voldemort/client/rebalance/RebalanceTest.java test/unit/voldemort/scheduled/StreamingSlopPusherTest.java test/unit/voldemort/server/gossip/GossiperTest.java | 16 October 2012, 21:34:08 UTC |
03c60ce | Jay J Wylie | 12 September 2012, 18:00:53 UTC | Adding a specific mini test that exercises ServerTestUtils.startVoldemortServer. This ~15 line program that simply starts some Voldemort servers using test utils can tickle two different intermittent failures: (1) ObsoleteVersionException when loading cluster.xml Testcase: startMultipleVoldemortServers took 0.385 sec Caused an ERROR A successor version version() to this version() exists for key cluster.xml voldemort.versioning.ObsoleteVersionException: A successor version version() to this version() exists for key cluster.xml and (2) A bind issue characterized as follows: Testcase: startMultipleVoldemortServers took 2.066 sec Caused an ERROR java.net.BindException: Address already in use voldemort.VoldemortException: java.net.BindException: Address already in use at voldemort.server.niosocket.NioSocketService.startInner(NioSocketService.java:131) at voldemort.server.AbstractService.start(AbstractService.java:62) at voldemort.server.VoldemortServer.startInner(VoldemortServer.java:255) at voldemort.server.AbstractService.start(AbstractService.java:62) at voldemort.ServerTestUtils.startVoldemortServer(ServerTestUtils.java:666) at voldemort.utils.ServerTestUtilsTest.setUp(ServerTestUtilsTest.java:50) Caused by: java.net.BindException: Address already in use at sun.nio.ch.Net.bind(Native Method) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) at voldemort.server.niosocket.NioSocketService.startInner(NioSocketService.java:125) | 16 October 2012, 21:34:08 UTC |
d685b67 | Abhinay Nagpal | 16 October 2012, 21:29:06 UTC | fixed try catch in versioned avro serializer | 16 October 2012, 21:29:06 UTC |
1524721 | Abhinay Nagpal | 16 October 2012, 03:10:09 UTC | Added testcase for schema evolution check | 16 October 2012, 03:10:09 UTC |
5aacdc7 | Abhinay Nagpal | 16 October 2012, 02:52:20 UTC | Added comments to the new functions | 16 October 2012, 02:52:20 UTC |
20261b9 | Abhinay Nagpal | 15 October 2012, 19:18:28 UTC | - Refactored schema check method - added fix to the verioned serializer to support writing of objects created using the old schema | 15 October 2012, 20:27:03 UTC |
f2bfbc0 | Abhinay Nagpal | 15 October 2012, 17:26:19 UTC | Added check in serializer if writer's schema greater than reader raise an exception | 15 October 2012, 20:27:03 UTC |
1ba1779 | Abhinay Nagpal | 13 October 2012, 19:14:41 UTC | Added support for Avro schema evolution in RO Stores | 15 October 2012, 20:27:03 UTC |
0c4bef5 | Chinmay Soman | 15 October 2012, 18:24:31 UTC | Updated AsyncMetadataVersionManagerTest for checking individual store definition updates. Added mechanism in VoldemortAdminTool to update individual store metadata version | 15 October 2012, 18:24:31 UTC |
8804f79 | Chinmay Soman | 12 October 2012, 18:56:21 UTC | Added the ability to auto-bootstrap on store definition changes | 12 October 2012, 19:02:40 UTC |
5e00c76 | Abhinay Nagpal | 12 October 2012, 02:50:30 UTC | code cleanup | 12 October 2012, 02:50:30 UTC |
d919558 | Abhinay Nagpal | 11 October 2012, 23:40:48 UTC | fixed test case | 11 October 2012, 23:40:48 UTC |
dc4d7b6 | Abhinay Nagpal | 01 October 2012, 23:26:18 UTC | Changed test case to Junit 4 | 11 October 2012, 22:29:12 UTC |
f66c20d | Abhinay Nagpal | 01 October 2012, 22:26:41 UTC | Refactored checkcompatibility into Validator class as a static method | 11 October 2012, 22:29:12 UTC |
46f42fe | Abhinay Nagpal | 01 October 2012, 20:59:46 UTC | Added check for schema backwards compatibility for Avro in Admin Client tool and server startup | 11 October 2012, 22:21:02 UTC |
9656114 | Abhinay Nagpal | 19 September 2012, 00:47:24 UTC | Fixed comment Please enter the commit message for your changes. Lines starting | 11 October 2012, 21:59:54 UTC |
6aaecc8 | Abhinay Nagpal | 19 September 2012, 00:42:23 UTC | Added unit test | 11 October 2012, 21:59:54 UTC |
4b83abd | Abhinay Nagpal | 18 September 2012, 02:39:09 UTC | Added support for schema evolution for the Avro generic serializer | 11 October 2012, 21:59:54 UTC |
79d9163 | Jay J Wylie | 11 October 2012, 15:29:46 UTC | Added comment to explain why NPEs can end up in the log during shutdown if there async requests are queued up. | 11 October 2012, 15:29:46 UTC |
a34e62a | Jay J Wylie | 11 October 2012, 03:38:52 UTC | Changed both serial (sync) operations and parallel (async) operations to deduct the elapsed checkout time from the operation (routing) timeout for specific requests. | 11 October 2012, 03:38:52 UTC |
bb73de1 | Jay J Wylie | 10 October 2012, 20:42:47 UTC | Fixed up ClientSocketStatsTest to match change in return code from -1 to 0. | 10 October 2012, 20:42:47 UTC |
0df53c0 | Jay J Wylie | 10 October 2012, 16:52:30 UTC | Minor fixes to various comments to clarify some implementation/usage details. | 10 October 2012, 16:52:30 UTC |
31bc42e | Jay J Wylie | 09 October 2012, 21:07:05 UTC | Added @override to some methods as Eclipse asked me to. Fixed missing include in test. | 09 October 2012, 21:07:05 UTC |
1890420 | Jay J Wylie | 09 October 2012, 16:24:32 UTC | Changes to make tight timing tests for QueuedKeyedResourcePool and SlowStorageEngine less sensitive on slower machines. | 09 October 2012, 20:26:14 UTC |
e070703 | Jay J Wylie | 09 October 2012, 02:20:18 UTC | Clean up get stats methods in (Queued)KeyedResourcePool. Fix error in test case. | 09 October 2012, 20:26:13 UTC |
0626f60 | Jay J Wylie | 09 October 2012, 01:57:29 UTC | Switched SlowStorageEngine to take a StorageEngine<K,V,T> in the constructor to be more flexible. | 09 October 2012, 20:26:13 UTC |
e372717 | Jay J Wylie | 08 October 2012, 23:23:56 UTC | Fixed E2E non blocking checkout test to actually check for non-blocking checkouts. (Addresses review feedback from Chinmay Soman.) | 09 October 2012, 20:26:13 UTC |
4e6e8b4 | Jay J Wylie | 08 October 2012, 22:58:16 UTC | synchronize the reset of a specific keyed pool to avoid invoking destroyResource on the same resource multiple times. | 09 October 2012, 20:26:13 UTC |
a3ca980 | Jay J Wylie | 08 October 2012, 22:33:50 UTC | bumped up test timeouts since Hudson seems slower than local machine for contention experiments. | 09 October 2012, 20:26:13 UTC |
f2466fa | Jay J Wylie | 05 October 2012, 16:48:07 UTC | Copyright statement cleanup. | 09 October 2012, 20:26:13 UTC |
b4c3bff | Jay J Wylie | 05 October 2012, 16:18:23 UTC | Additional Jmx Getters so that we can better understand stats sample sizes. | 09 October 2012, 20:26:13 UTC |
133b9c7 | Jay J Wylie | 05 October 2012, 15:33:53 UTC | Minor changes to deal with remaining TODOs in this change. I still believe there are some ugly code paths that fire off too many exceptions when we tear down a connection. Hopefully, the connection re-write that is starting off will clean up these ugly code paths. | 09 October 2012, 20:26:13 UTC |
a28bcd9 | Jay J Wylie | 04 October 2012, 22:26:59 UTC | Minor cleanup --- changed some todos to documentation and comments. | 09 October 2012, 20:26:13 UTC |