https://github.com/apache/spark
Revision 8ccc4788154080e8508818c3a612c364edfeef59 authored by Shahid on 24 September 2018, 21:17:42 UTC, committed by Marcelo Vanzin on 24 September 2018, 21:18:20 UTC
## What changes were proposed in this pull request?
Test steps :
1)  bin/spark-shell --conf spark.ui.retainedTasks=200
```
val rdd = sc.parallelize(1 to 1000, 1000)
rdd.count
```

Stage tab in the UI will display 10 pages with 100 tasks per page. But number of retained tasks is only 200. So, from the 3rd page onwards will display nothing.
 We have to calculate total pages based on the number of tasks need display in the UI.

**Before fix:**
![empty_4](https://user-images.githubusercontent.com/23054875/45918251-b1650580-bea1-11e8-90d3-7e0d491981a2.jpg)

**After fix:**
![empty_3](https://user-images.githubusercontent.com/23054875/45918257-c2ae1200-bea1-11e8-960f-dfbdb4a90ae7.jpg)

## How was this patch tested?

Manually tested

Closes #22526 from shahidki31/SPARK-25502.

Authored-by: Shahid <shahidki31@gmail.com>
Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
(cherry picked from commit 3ce2e008ec1bf70adc5a4b356e09a469e94af803)
Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
1 parent 7edfdfc
History
Tip revision: 8ccc4788154080e8508818c3a612c364edfeef59 authored by Shahid on 24 September 2018, 21:17:42 UTC
[SPARK-25502][CORE][WEBUI] Empty Page when page number exceeds the reatinedTask size.
Tip revision: 8ccc478

README.md

back to top