swh:1:snp:5115096b921df712aeb2a08114fede57fb3331fb
Revision 993543d1be985cadcb237a8a8545ffe6c755bd54 authored by Mark Callaghan on 02 March 2013, 20:56:04 UTC, committed by Mark Callaghan on 04 March 2013, 15:41:15 UTC
Summary:
This adds the rate_delay_limit_milliseconds option to make the delay
configurable in MakeRoomForWrite when the max compaction score is too high.
This delay is called the Ln slowdown. This change also counts the Ln slowdown
per level to make it possible to see where the stalls occur.

From IO-bound performance testing, the Level N stalls occur:
* with compression -> at the largest uncompressed level. This makes sense
                      because compaction for compressed levels is much
                      slower. When Lx is uncompressed and Lx+1 is compressed
                      then files pile up at Lx because the (Lx,Lx+1)->Lx+1
                      compaction process is the first to be slowed by
                      compression.
* without compression -> at level 1

Task ID: #1832108

Blame Rev:

Test Plan:
run with real data, added test

Revert Plan:

Database Impact:

Memcache Impact:

Other Notes:

EImportant:

- begin *PUBLIC* platform impact section -
Bugzilla: #
- end platform impact -

Reviewers: dhruba

Reviewed By: dhruba

Differential Revision: https://reviews.facebook.net/D9045
1 parent 806e264
History
Tip revision: 19076c95aa2bcee55c26fcf0960cc844ad86ee9c authored by Levi Tamasi on 21 January 2021, 22:18:25 UTC
Update HISTORY.md for PR 7888 (#7890)
Tip revision: 19076c9
File Mode Size
VALGRIND_LOGS
db
doc
hdfs
helpers
include
java
linters
port
scribe
snappy
table
thrift
tools
util
.arcconfig -rw-r--r-- 243 bytes
.gitignore -rw-r--r-- 174 bytes
LICENSE -rw-r--r-- 1.4 KB
Makefile -rw-r--r-- 10.8 KB
README -rw-r--r-- 2.2 KB
README.fb -rw-r--r-- 98 bytes
build_detect_platform -rwxr-xr-x 8.5 KB
build_detect_version -rwxr-xr-x 1.1 KB
build_java.sh -rwxr-xr-x 1.9 KB
fbcode.clang31.sh -rw-r--r-- 3.1 KB
fbcode.gcc471.sh -rw-r--r-- 2.8 KB
regression_build_test.sh -rwxr-xr-x 2.3 KB
valgrind_test.sh -rwxr-xr-x 411 bytes

README

back to top