Skip to main content

Browse the archive

Revision 2db6101001512fe80998d99cfb972ee51614dfcc authored by Shixiong Zhu on 17 May 2017, 21:13:49 UTC, committed by Shixiong Zhu on 17 May 2017, 21:13:56 UTC 
[SPARK-20788][CORE] Fix the Executor task reaper's false alarm warning logs
 
## What changes were proposed in this pull request?

Executor task reaper may fail to detect if a task is finished or not when a task is finishing but being killed at the same time.

The fix is pretty easy, just flip the "finished" flag when a task is successful.

## How was this patch tested?

Jenkins

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #18021 from zsxwing/SPARK-20788.

(cherry picked from commit f8e0f0f47c15ddd646b9f295b91d6748583fe011)
Signed-off-by: Shixiong Zhu <shixiong@databricks.com>
1 parent dac0b50
History
File Mode Size
cluster-overview.png -rw-r--r-- 22.4 KB
cluster-overview.pptx -rw-r--r-- 27.5 KB
edge_cut_vs_vertex_cut.png -rw-r--r-- 49.8 KB
glyphicons-halflings-white.png -rwxr-xr-x 8.6 KB
glyphicons-halflings.png -rwxr-xr-x 12.5 KB
graphx_figures.pptx -rw-r--r-- 1.1 MB
graphx_logo.png -rw-r--r-- 22.3 KB
java-sm.png -rw-r--r-- 670 bytes
ml-Pipeline.png -rw-r--r-- 37.6 KB
ml-PipelineModel.png -rw-r--r-- 38.3 KB
ml-Pipelines.pptx -rw-r--r-- 55.4 KB
property_graph.png -rw-r--r-- 132.5 KB
python-sm.png -rw-r--r-- 1.4 KB
scala-sm.png -rw-r--r-- 2.2 KB
spark-logo-hd.png -rw-r--r-- 11.0 KB
spark-webui-accumulators.png -rw-r--r-- 156.4 KB
streaming-arch.png -rw-r--r-- 50.8 KB
streaming-dstream-ops.png -rw-r--r-- 32.7 KB
streaming-dstream-window.png -rw-r--r-- 26.0 KB
streaming-dstream.png -rw-r--r-- 17.4 KB
streaming-figures.pptx -rw-r--r-- 866.7 KB
streaming-flow.png -rw-r--r-- 19.9 KB
streaming-kinesis-arch.png -rw-r--r-- 84.3 KB
structured-streaming-example-model.png -rw-r--r-- 77.5 KB
structured-streaming-late-data.png -rw-r--r-- 89.4 KB
structured-streaming-model.png -rw-r--r-- 36.4 KB
structured-streaming-stream-as-a-table.png -rw-r--r-- 46.7 KB
structured-streaming-watermark-append-mode.png -rw-r--r-- 243.4 KB
structured-streaming-watermark-update-mode.png -rw-r--r-- 292.1 KB
structured-streaming-window.png -rw-r--r-- 86.0 KB
structured-streaming.pptx -rw-r--r-- 1.1 MB
triplet.png -rw-r--r-- 18.8 KB
vertex_routing_edge_tables.png -rw-r--r-- 315.6 KB
back to top