Skip to main content

Browse the archive

Revision 5ee62b65e032973f83f45c3cf99006c3e5ce6ad4 authored by Felix GV on 12 January 2016, 03:08:56 UTC, committed by Felix GV on 12 January 2016, 06:56:22 UTC 
Changed HDFS directory size measurement in HdfsFetcher.
 
This fixes two issues in 'build.primary.replicas.only':
1. The progress report in the AsyncTask was wrong, which
   also resulted in erroneous logs in the BnP job.
2. The previous implementation was DDOSing the NameNode
   with a furious amount of ListStatus operation, most
   of which it did not even need to get the result of.

Also added retry with random back off when the ListStatus
operations fail, and cleaned up HdfsFetcherAdvancedTest a
little bit.
1 parent 1fd44c9
History
File Mode Size
PREUPGRADE_FOR_1_1_X_README -rw-r--r-- 5.0 KB
generate_cluster_xml.py -rwxr-xr-x 8.2 KB
read-only-file-validator.sh -rwxr-xr-x 414 bytes
rebalance-cluster-expansion.sh -rwxr-xr-x 5.3 KB
rebalance-new-zoned-cluster.sh -rwxr-xr-x 5.0 KB
rebalance-shuffle.sh -rwxr-xr-x 6.5 KB
rebalance-zone-expansion.sh -rwxr-xr-x 6.3 KB
rebalance-zone-shrinkage.sh -rwxr-xr-x 3.2 KB
repeat-junit-test.sh -rwxr-xr-x 2.8 KB
repeat-junit.sh -rwxr-xr-x 2.1 KB
run-bnp.sh -rwxr-xr-x 1.0 KB
run-class.bat -rw-r--r-- 1.4 KB
run-class.sh -rwxr-xr-x 1.3 KB
vadmin.bat -rw-r--r-- 1.0 KB
vadmin.sh -rwxr-xr-x 941 bytes
voldemort-admin-tool.bat -rw-r--r-- 902 bytes
voldemort-admin-tool.sh -rwxr-xr-x 805 bytes
voldemort-convert-bdb.bat -rw-r--r-- 1.4 KB
voldemort-convert-bdb.sh -rwxr-xr-x 1.2 KB
voldemort-coordinator-admin.sh -rwxr-xr-x 976 bytes
voldemort-coordinator.bat -rw-r--r-- 1.8 KB
voldemort-coordinator.sh -rwxr-xr-x 1.6 KB
voldemort-performance-tool.bat -rw-r--r-- 796 bytes
voldemort-performance-tool.sh -rwxr-xr-x 705 bytes
voldemort-prod-server.sh -rwxr-xr-x 1.3 KB
voldemort-server.bat -rw-r--r-- 1.4 KB
voldemort-server.sh -rwxr-xr-x 1.2 KB
voldemort-shell.bat -rw-r--r-- 853 bytes
voldemort-shell.sh -rwxr-xr-x 742 bytes
voldemort-stop.sh -rwxr-xr-x 961 bytes
voldemort-thin-client-shell.bat -rw-r--r-- 1.0 KB
voldemort-thin-client-shell.sh -rwxr-xr-x 860 bytes
back to top