https://github.com/apache/spark
Revision 9051e1a265dc0f1dc19fd27a0127ffa47f3ac245 authored by Sandor Murakozi on 14 January 2018, 14:32:35 UTC, committed by Sean Owen on 14 January 2018, 14:32:43 UTC
## What changes were proposed in this pull request? In 2.2, Spark UI displayed the stage description if the job description was not set. This functionality was broken, the GUI has shown no description in this case. In addition, the code uses jobName and jobDescription instead of stageName and stageDescription when JobTableRowData is created. In this PR the logic producing values for the job rows was modified to find the latest stage attempt for the job and use that as a fallback if job description was missing. StageName and stageDescription are also set using values from stage and jobName/description is used only as a fallback. ## How was this patch tested? Manual testing of the UI, using the code in the bug report. Author: Sandor Murakozi <smurakozi@gmail.com> Closes #20251 from smurakozi/SPARK-23051. (cherry picked from commit 60eeecd7760aee6ce2fd207c83ae40054eadaf83) Signed-off-by: Sean Owen <sowen@cloudera.com>
1 parent 5fbbd94
Tip revision: 9051e1a265dc0f1dc19fd27a0127ffa47f3ac245 authored by Sandor Murakozi on 14 January 2018, 14:32:35 UTC
[SPARK-23051][CORE] Fix for broken job description in Spark UI
[SPARK-23051][CORE] Fix for broken job description in Spark UI
Tip revision: 9051e1a
| File | Mode | Size |
|---|---|---|
| .github | ||
| R | ||
| assembly | ||
| bin | ||
| build | ||
| common | ||
| conf | ||
| core | ||
| data | ||
| dev | ||
| docs | ||
| examples | ||
| external | ||
| graphx | ||
| hadoop-cloud | ||
| launcher | ||
| licenses | ||
| mllib | ||
| mllib-local | ||
| project | ||
| python | ||
| repl | ||
| resource-managers | ||
| sbin | ||
| sql | ||
| streaming | ||
| tools | ||
| .gitattributes | -rw-r--r-- | 40 bytes |
| .gitignore | -rw-r--r-- | 1.3 KB |
| .travis.yml | -rw-r--r-- | 1.7 KB |
| CONTRIBUTING.md | -rw-r--r-- | 995 bytes |
| LICENSE | -rw-r--r-- | 17.6 KB |
| NOTICE | -rw-r--r-- | 24.3 KB |
| README.md | -rw-r--r-- | 3.7 KB |
| appveyor.yml | -rw-r--r-- | 2.3 KB |
| pom.xml | -rw-r--r-- | 99.2 KB |
| scalastyle-config.xml | -rw-r--r-- | 17.2 KB |
Computing file changes ...
