Revision a5ccbced8c1d6f41e5287269294642f32e445976 authored by madianjun on 06 December 2019, 07:39:49 UTC, committed by Dongjoon Hyun on 06 December 2019, 07:39:49 UTC
### What changes were proposed in this pull request? A bug fixed about the code in getBlockHosts() function. In the case "The fragment ends at a position within this block", the end of fragment should be before the end of block，where the "end of block" means `b.getOffset + b.getLength`，not `b.getLength`. ### Why are the changes needed? When comparing the fragment end and the block end，we should use fragment's `offset + length`，and then compare to the block's `b.getOffset + b.getLength`, not the block's length. ### Does this PR introduce any user-facing change? No. ### How was this patch tested? No test. Closes #26650 from mdianjun/fix-getBlockHosts. Authored-by: madianjun <madianjun@jd.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
1 parent da27f91
| File | Mode | Size |
|---|---|---|
| ml | ||
| mllib | ||
| sql | ||
| streaming | ||
| testing | ||
| tests | ||
| __init__.py | -rw-r--r-- | 4.4 KB |
| _globals.py | -rw-r--r-- | 2.2 KB |
| accumulators.py | -rw-r--r-- | 9.2 KB |
| broadcast.py | -rw-r--r-- | 7.1 KB |
| cloudpickle.py | -rw-r--r-- | 47.2 KB |
| conf.py | -rw-r--r-- | 7.4 KB |
| context.py | -rw-r--r-- | 50.5 KB |
| daemon.py | -rw-r--r-- | 7.4 KB |
| files.py | -rw-r--r-- | 1.8 KB |
| find_spark_home.py | -rwxr-xr-x | 2.7 KB |
| heapq3.py | -rw-r--r-- | 36.7 KB |
| java_gateway.py | -rw-r--r-- | 9.6 KB |
| join.py | -rw-r--r-- | 3.9 KB |
| profiler.py | -rw-r--r-- | 5.6 KB |
| rdd.py | -rw-r--r-- | 100.0 KB |
| rddsampler.py | -rw-r--r-- | 4.2 KB |
| resourceinformation.py | -rw-r--r-- | 1.5 KB |
| resultiterable.py | -rw-r--r-- | 1.2 KB |
| serializers.py | -rw-r--r-- | 31.3 KB |
| shell.py | -rw-r--r-- | 2.3 KB |
| shuffle.py | -rw-r--r-- | 27.2 KB |
| statcounter.py | -rw-r--r-- | 5.0 KB |
| status.py | -rw-r--r-- | 3.7 KB |
| storagelevel.py | -rw-r--r-- | 2.6 KB |
| taskcontext.py | -rw-r--r-- | 7.4 KB |
| traceback_utils.py | -rw-r--r-- | 2.6 KB |
| util.py | -rw-r--r-- | 6.3 KB |
| version.py | -rw-r--r-- | 834 bytes |
| worker.py | -rw-r--r-- | 26.9 KB |
Computing file changes ...
