swh:1:snp:764524290233376de64947417267228741ce2485

sort by:
Revision Author Date Message Commit Date
c420a98 Open source release 1.3.0 08 March 2013, 21:01:08 UTC
3f0803b Adding ConnectException back as catastrophic exception until the time FD is fixed 08 March 2013, 17:16:24 UTC
ce73194 More Javadoc fixes 08 March 2013, 03:26:37 UTC
6aa7f4b Adding javadocs + fixing some flaky tests + making ConnectException non catastrophic 06 March 2013, 22:07:14 UTC
5beaa50 Better BDB default configs 06 March 2013, 22:07:14 UTC
0530378 Preventing truncate() during failed store opens 06 March 2013, 22:05:53 UTC
d9c63f9 Fix adding a store dynamically, with online retention on 06 March 2013, 22:05:53 UTC
b98b2b2 Added a necessary import statement in RepairJob for ReadOnlyStorageConfiguration 02 March 2013, 23:41:11 UTC
41bf1db Merge pull request #123 from baepiff/repair_job/mysql delete mysql from blacklist 01 March 2013, 18:49:17 UTC
eb5d559 Merge pull request #120 from baepiff/restore/mysql Enable mysql to execute restore 01 March 2013, 18:44:48 UTC
8851652 Fixed warning message 01 March 2013, 01:28:08 UTC
a9658b9 Fixed comments 01 March 2013, 01:28:08 UTC
b800b61 Fixed the build.xml to produce the correct manifest in the voldemort jar 01 March 2013, 01:28:08 UTC
347650f Use the resources supplied by the classloader to load the manifest file absolute / relative file sytem paths dont work anymore because when you run this in a servlet container everything is relative to its context hence we use the right method of loading resources we probably need a better key to the implmenetation version - because if there exists another manifest file with the same key in the same servlet container we are doomed as we return its implementation version 01 March 2013, 01:28:08 UTC
a72bcca Set the map-reduce tokens so that they can be delegated 28 February 2013, 22:42:47 UTC
75e5bbb Exposed property names as constants 28 February 2013, 22:42:46 UTC
3d388a0 1) Remove the use of using jars in Hadoop while doing the Build phase 2) Added a prioperty voldemort.distributedcache to indicate apath controlled by azkaban to load jars into distributed cache 28 February 2013, 22:42:46 UTC
abfe406 Merge pull request #126 from baepiff/CmdUtils/valueof/bug fixed valueof method to handle null value 27 February 2013, 16:07:17 UTC
8b309a0 Updating Version and release_notes for release 1.2.3 20 February 2013, 23:08:42 UTC
c902517 Refactored some try catch blocks. Also returning VoldemortException back from fetch function instead of null. This improves Azkaban visibility. 20 February 2013, 21:30:21 UTC
0881e1f Fixed a small bug in the retry logic for getting the FileSystem 20 February 2013, 21:30:21 UTC
6b4f77b Adding a retry loop while getting a filesystem object in a kerberized block. This is meant to get around the intermittent Hadoop failures. 20 February 2013, 21:30:21 UTC
0391625 Check if logger.isDebugEnaled() to optimize loggin 19 February 2013, 19:33:29 UTC
f50c241 removed the reentrant lock 19 February 2013, 19:33:29 UTC
5cf07d3 making streamingput() synchronized 19 February 2013, 19:33:29 UTC
2c574e2 changing looging leve from info to debug for commit messages 19 February 2013, 19:33:29 UTC
3367757 some cleanup# On branch streaming-fixes 19 February 2013, 19:33:29 UTC
5ecc748 Rebased changes -- the test case now also has the method to verify if the keys are actually in the server 19 February 2013, 19:33:28 UTC
48e9df3 added a reentrantlock to synchronize access the streamingclient consumer may implement a time based flushing through a scheduled executor service or a timer thread(like in YASP) this helps achieveing a lock step access 19 February 2013, 19:33:28 UTC
8c6d25d Merge pull request #94 from ctasada/windows-files Added windows batch files. See comment in header of each file that these BAT files are not tested with each Voldemort release. We hope this helps the community, but cannot commit to testing each release on windows. 19 February 2013, 15:53:22 UTC
0d9a47d Update Windows Batch files Updated copyright info to make clear that these files are not maintained by LinkedIn 19 February 2013, 09:53:22 UTC
c94b8c5 Merge pull request #121 from baepiff/baepiff/generate_cluster_xml Added file option to generate_cluster_xml 12 February 2013, 06:17:34 UTC
c61182a fixed wrong variable name and modified poor expressions 12 February 2013, 02:57:37 UTC
a9a23f6 added hosts list file option 12 February 2013, 02:57:37 UTC
8dcc833 Catching Throwable during the creation of secured filesystem object 07 February 2013, 19:14:57 UTC
a825cec Fixed a bug with the key.selection and value.selection in build and push verifyschema() now takes the schema of the subfiled rather than entire record if this property is enforced 06 February 2013, 23:05:25 UTC
ab03d02 Made streaming partially threadsafe for the timer thread to call commits periodically exposed the commit method 06 February 2013, 21:53:09 UTC
0d6c192 Refactoring AdminClient operations 31 January 2013, 04:26:32 UTC
8315bfe Added test case for streamingclient 30 January 2013, 00:53:21 UTC
f9963e9 new branch for streaming client based off current master 30 January 2013, 00:53:21 UTC
6e28bb7 Addressed most review feedback on BindException fixes. .classpath - fixed error I introduced. *RebalanceTest.java - refactored to reduce cut&paste code - added comments and one TODO about attempting a proper fix wrt BindExceptions later. ServerTestUtils.java - renamed method back to startVoldemortServer - added 'throws BindException' test/unit/voldemort/scheduled/StreamingSlopPusherTest.java - added comment clarifying why this test is hard to harden against BindException issue 26 January 2013, 00:14:00 UTC
340ea39 Better documented the risks of invoking ServerTestUtils.startVoldemortServer test/common/voldemort/ServerTestUtils.java - Renamed startVoldemortServer to startVoldemortServerInMannerThatMayResultInBindException (The name is intentionally long and annoying. There are some tests that must call this method bare, but that should be strongly discouraged!!!) - Added method header that encourages BindException to be caught and masked 26 January 2013, 00:14:00 UTC
9f2e07c Fixed the re-introduction of BindExceptions upon start up of some recently added tests: All of the following tests directly used the method ServerTestUtils.startVoldemortServer test/unit/voldemort/client/ClientRegistryTest.java test/unit/voldemort/client/AdminFetchTest.java test/unit/voldemort/client/EndToEndRebootstrapTest.java test/unit/voldemort/store/system/AsyncMetadataVersionManagerTest.java test/unit/voldemort/store/system/SystemStoreTest.java This method of starting Voldemort servers is susceptible to BindException errors. Unless something very fancy is being done, the method ServerTestUtils.startVoldemortCluster should be used to start a cluster within a test. test/unit/voldemort/client/ClientRegistryTest.java extended from TestCase. This is a "Junit3" idiom that we should not use in new tests. The Junit4 approach to tests relies solely on annotation. 26 January 2013, 00:14:00 UTC
0cbbecc Updated build.properties and release_notes for release 1.2.0 21 January 2013, 23:34:23 UTC
442ca46 admin api to fetch orphaned keys/entries 21 January 2013, 19:09:24 UTC
1b57663 Tweaked SimpleCounterTest to avoid passing negative value to sleep if GC or other pause occurs at inopportune point during test. 21 January 2013, 04:19:26 UTC
10353a5 Update release to 1.1.9 and updated release notes. 15 January 2013, 21:47:56 UTC
a2c30c0 Fix to copyright notices that I accidentally changed by one year... 15 January 2013, 19:43:49 UTC
b120f45 Reverted refactoring of PerformParallel* classes committed in f37b25ecdd14ac27480a8ca353cae919464df3af 15 January 2013, 19:43:49 UTC
eecaba0 Moved stress test for connection checkout/checkin and failure detector to long unit test. Cleaned up comments in ClientRequestExecutorPool to make intended semantics clearer. 15 January 2013, 19:43:49 UTC
79277d1 Updated copyright notices in all files I touched. 15 January 2013, 19:43:49 UTC
076229f Minor changes to tests - renamed base keyedresourcepool test to avoid pattern that ant/junit uses to try and run tests. - tweaked stress tests parameters once more to make it easier to run locally. 15 January 2013, 19:43:48 UTC
1f3a466 Substantial refactoring of (Queued)KeyedResourcePool tests. - factored out a common base class in which all of the nested helper classes are defined - separated out the various types of tests into files: - simple/basic tests - contention tests that spawn threads to generate contention - specific race condition test - The specific race condition test for KeyedResourcePool shows that google issue 276 is resolved: http://code.google.com/p/project-voldemort/issues/detail?id=276 15 January 2013, 19:43:48 UTC
1c15b5a Minor changes to end-to-end stress test. 15 January 2013, 19:43:48 UTC
4a3b985 Minor tweak to single stress test parameters. 15 January 2013, 19:43:48 UTC
5686a52 Fix for possible race condition for resource creation in KeyedResourcePool See also http://code.google.com/p/project-voldemort/issues/detail?id=276 15 January 2013, 19:43:48 UTC
efe9f21 Clean up of TODOs and cruft code that had been introduced. 15 January 2013, 19:43:48 UTC
526deff Added stress test and cleaned up client request executor pool reset. reset(dest) - changed behavior to match original KeyedResourcePool implementation. The original QueuedKeyedResourcePool.reset() was an unnecessary/bad behavior change that canceled enqueued requests. The original behavior was to destroy idle resources whenever pool is reset. test/integration/voldemort/socketpool/E2EClientRequestExecutorPoolAndFailureDetectorTest.java - stress test that has put and get threads contend for slow servers in such a manner as to trigger failure detection to mark nodes unavailable. This excercises connection tear down, reset(), and build up again. This also exercises the code paths in which callbacks do heavyweight work. 15 January 2013, 19:43:48 UTC
ddfbb17 Interim checkin with an ugly example of how threads could be created to handle callback work. The ugly code is commented out. 15 January 2013, 19:43:48 UTC
3162ba2 Refactor all PerformParallel*Request classes. - got rid of anonymous call back classes - factored out waitForResponses logic and processResponses logic for most of these classes. GetAll stands out as being fairly different from the others. - did not refactor to the point of sharing common code across classes, just refactored within each class. - added many TODOs to the code for further refactoring. 15 January 2013, 19:43:48 UTC
551b96d Reduce granularity of failure detector locking and do not destroy all enqueued requests upon setUnavailable. src/java/voldemort/cluster/failuredetector/ThresholdFailureDetector.java - Reduce amount of work done within synchronized section to reduce lock granularity and so ensure "side effects" of node being marked (un)available are not w/in sync section. src/java/voldemort/store/socket/clientrequest/ClientRequestExecutorPool.java - Added TODO/comment to decide whether we want to actively destroy all connections upon node being marked unavailable - Switched behavior to lazily destroying connections. 15 January 2013, 19:43:48 UTC
3aaabcc Less verbose logging in the face of expected exceptions and error logging in the face of a slop not being written. src/java/voldemort/cluster/failuredetector/AbstractFailureDetector.java - less verbose logging when a node is unavailable src/java/voldemort/store/routed/action/AbstractAction.java - less verbose logging in the face of expected "exceptional" responses. src/java/voldemort/store/slop/HintedHandoff.java - ensure that an error message is logged if a slop is not written (we can grep for "Slop write of key.*was not written" in logs) - added TODO because ObsoleteVersionExceptiosn are neither treated as failures or successes in the callback to sendHintParallel. test/integration/voldemort/nonblocking/E2ENonblockingCheckoutTest.java - minor fix test/unit/voldemort/server/socket/ClientRequestExecutorPoolTest.java - from junit3 to junit4 15 January 2013, 19:43:48 UTC
e365419 Minor code clean up based on review feedback Protected all logger.(debug|info) statements I added with an is(Debug|Info)Enabled() check. Made AsyncRecoveryFailureDetector less verbose. When it polls a server to see if it is available, it now prints out a clean INFO level message. It had been printing out a WARN level message *with* a stacktrace that made this expected behavior look much scarier than it really is. 15 January 2013, 19:43:48 UTC
4c69fb6 Change monitoring interval in ClientSocketStats to have larger window. 15 January 2013, 19:43:48 UTC
03214c9 Clean up INFO debugging messages to be DEBUG. Minor other clean up too. 15 January 2013, 19:43:48 UTC
e29b222 Added INFO level messages to better understand the performance of per-request instrumentation. Expect to remove most of this after debugging. 15 January 2013, 19:43:48 UTC
7b8d30c Minor tweak to reduce INFO logging for KeyedResourcePool::attemptGrow 15 January 2013, 19:43:48 UTC
515b139 Reverting minor-minor version change in build.properties. 15 January 2013, 19:43:13 UTC
adf1c36 Added INFO level messages to better understand resetting stats in ClientSocketStats. Expect to remove this after debugging. 15 January 2013, 19:41:47 UTC
e6ec7a0 Added INFO level messages to better understand connection creation. Expet to remove most of this after debugging. src/java/voldemort/store/socket/clientrequest/ClientRequestExecutorFactory.java - print out time to establish connection (if it takes longer than 1 ms) src/java/voldemort/utils/pool/KeyedResourcePool.java - print out info about object creation (connection establishment). In particular, how many outstanding creations (connection establishments) are in flight and how many idle resources are in the pool after the newly created resource is checked in. 15 January 2013, 19:41:47 UTC
b4994bb Added INFO level messages to better understand statistics tracking (StoreStats, SocketClientStats, Histogram) behavior. Expect to remove most of these messages after debugging. src/java/voldemort/store/stats/Histogram.java - one more check to harden the imnplementation of insert src/java/voldemort/store/stats/RequestCounter.java - durationMs from int to long - print out timing of histogram reset (q95, q99, reset) 15 January 2013, 19:41:47 UTC
90aabc3 Fixed Histogram: halved memory footprint, test boundary conditions, dropped unnecessary binary search. These changes preserve/correct behavior of the current Histogram. src/java/voldemort/store/stats/Histogram.java - Halved memory footprint by dropping unnecessary "bounds" array - Dropped unnecessary binary search, making insert O(1) rather than O(log(nBuckets)) - Improved documentation - Made interface consistent for type of values inserted/got from histogram (i.e., all are 'long') test/unit/voldemort/store/stats/HistogramTest.java - Added tests for boundary conditions: -ive values are dropped on insert, "too large" values are bucketed in the final bucket on insert. Minor fixes to RequestCounter calls to histogram to conform to 'long' interfaces. 15 January 2013, 19:41:47 UTC
1ac1b32 Remove an unnecessary synchronization primitive from keyedresourcepool. 15 January 2013, 19:39:32 UTC
2768eef Changed reset and destroyRequestQueue to avoid any heavy weight synchronization methods. This should fix deadlock issue. 15 January 2013, 19:39:32 UTC
2b30b33 Change async checkout behavior to be more like sync checkout: only create resources (connections) when they are needed. Now, connections should only be created on demand. The initial code created connections until the max limit of the pool was Some minor tweaks to test that confirm the desired behavior at a unit test level. 15 January 2013, 19:39:32 UTC
adc3eb9 Release notes & version update for 1.1.8 15 January 2013, 00:05:01 UTC
2d12189 Fixing intermittent test failures 14 January 2013, 22:06:52 UTC
3b6c282 Bug fixes in HdfsFetcher revealed by HdfsFetcherTest (NPE and hiding the VoldemortSerializationException) 14 January 2013, 02:52:29 UTC
f97699b Minor debug fixes 12 January 2013, 00:25:55 UTC
a18d91b Fixing .classpath which had the wrong hadoop-core version. Also changed the Mlock related info messages to debug. 11 January 2013, 23:43:00 UTC
c611a8c Updated the hadoop-core jar to 1.0.4-p2 11 January 2013, 23:42:06 UTC
4f5ce5b Added the ability to delete old checksum files in the Build and Push reducer. Also updated the hadoop core library to version 1.0.4-p2-rc2 containing the fix to the User ID command usage. 11 January 2013, 23:42:06 UTC
ec3b37e Improve batch modifications on BDB-JE 11 January 2013, 23:36:41 UTC
903e749 Monitoring for streaming operations 11 January 2013, 23:36:41 UTC
4ae1336 Fix tests for testStartVoldemortCluster to not consume so much memory test/common/voldemort/ServerTestUtils.java - remove stress test from normal testing - test the method startVoldemortCluster once and confirm it returns a non-null Cluster object test/common/voldemort/ServerTestUtils.java - clarified a comment 10 January 2013, 16:28:34 UTC
db493a1 Updated release_notes and release version to 1.1.7 including Kerberos related changes 04 January 2013, 00:09:05 UTC
5aa3716 NIO + BDB stats - Code review comments 02 January 2013, 21:37:43 UTC
dd29d0e Stats to understand NIO layer performance + BDB exception counts et al 02 January 2013, 21:37:43 UTC
22860f8 fixed valueof method to handle null value 26 December 2012, 07:51:07 UTC
fbe6718 Creating constants for the default kerberos principal and keytab path 07 December 2012, 23:34:43 UTC
ef5420f Removing the additional JVM args from the Voldemort scripts 07 December 2012, 01:15:20 UTC
7d93e6d Adding KDC info and other JVM arguments to the voldemort scripts 07 December 2012, 01:06:16 UTC
e7b93ba Adding a hack to bypass Kerberos authentication for hftp protocol. TODO: remove this bypass once the libhadoop on Solaris is well tested 06 December 2012, 19:54:19 UTC
22b99c3 Finalized changes to HdfsFetcher to make it work with a Kerberized Hadoop cluster over webhdfs 06 December 2012, 19:54:19 UTC
44c4667 Standardizing the Kerberos login phase : explicitly specify the Hadoop config and keytab path. Also assumes that extra kerberos related config parameters are passed to the Java process 06 December 2012, 19:54:19 UTC
577378e Correcting usage: proxyUser to kerberosUser 06 December 2012, 19:54:19 UTC
2965762 Fixing a bug where we dont need to have hadoop conf in the classpath 06 December 2012, 19:54:19 UTC
c8d7a6c Fix in FsPermission constructor to maintain hadoop jar backwards compatibility 06 December 2012, 19:54:19 UTC
0f2f85e Fixed a jmx unregister bug in hdfs fetcher 06 December 2012, 19:54:19 UTC
e6b24c6 Doing authentication in a synchronized block for the Hdfs fetcher, setting correct permission for the hadoop files 06 December 2012, 19:54:19 UTC
back to top