Revision a5ccbced8c1d6f41e5287269294642f32e445976 authored by madianjun on 06 December 2019, 07:39:49 UTC, committed by Dongjoon Hyun on 06 December 2019, 07:39:49 UTC
### What changes were proposed in this pull request? A bug fixed about the code in getBlockHosts() function. In the case "The fragment ends at a position within this block", the end of fragment should be before the end of block,where the "end of block" means `b.getOffset + b.getLength`,not `b.getLength`. ### Why are the changes needed? When comparing the fragment end and the block end,we should use fragment's `offset + length`,and then compare to the block's `b.getOffset + b.getLength`, not the block's length. ### Does this PR introduce any user-facing change? No. ### How was this patch tested? No test. Closes #26650 from mdianjun/fix-getBlockHosts. Authored-by: madianjun <madianjun@jd.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
1 parent da27f91
File | Mode | Size |
---|---|---|
ml | ||
mllib | ||
sql | ||
streaming | ||
testing | ||
tests | ||
__init__.py | -rw-r--r-- | 4.4 KB |
_globals.py | -rw-r--r-- | 2.2 KB |
accumulators.py | -rw-r--r-- | 9.2 KB |
broadcast.py | -rw-r--r-- | 7.1 KB |
cloudpickle.py | -rw-r--r-- | 47.2 KB |
conf.py | -rw-r--r-- | 7.4 KB |
context.py | -rw-r--r-- | 50.5 KB |
daemon.py | -rw-r--r-- | 7.4 KB |
files.py | -rw-r--r-- | 1.8 KB |
find_spark_home.py | -rwxr-xr-x | 2.7 KB |
heapq3.py | -rw-r--r-- | 36.7 KB |
java_gateway.py | -rw-r--r-- | 9.6 KB |
join.py | -rw-r--r-- | 3.9 KB |
profiler.py | -rw-r--r-- | 5.6 KB |
rdd.py | -rw-r--r-- | 100.0 KB |
rddsampler.py | -rw-r--r-- | 4.2 KB |
resourceinformation.py | -rw-r--r-- | 1.5 KB |
resultiterable.py | -rw-r--r-- | 1.2 KB |
serializers.py | -rw-r--r-- | 31.3 KB |
shell.py | -rw-r--r-- | 2.3 KB |
shuffle.py | -rw-r--r-- | 27.2 KB |
statcounter.py | -rw-r--r-- | 5.0 KB |
status.py | -rw-r--r-- | 3.7 KB |
storagelevel.py | -rw-r--r-- | 2.6 KB |
taskcontext.py | -rw-r--r-- | 7.4 KB |
traceback_utils.py | -rw-r--r-- | 2.6 KB |
util.py | -rw-r--r-- | 6.3 KB |
version.py | -rw-r--r-- | 834 bytes |
worker.py | -rw-r--r-- | 26.9 KB |
![swh spinner](/static/img/swh-spinner.gif)
Computing file changes ...