https://github.com/apache/spark
Revision 84ed6142ef5f4caa4ef94685a8fc5e0105231aea authored by Hyukjin Kwon on 26 July 2022, 06:03:17 UTC, committed by Hyukjin Kwon on 26 July 2022, 06:03:28 UTC
### What changes were proposed in this pull request?

This PR increases the number of partitions further more (see also https://github.com/apache/spark/pull/37270)

### Why are the changes needed?

To make the build pass.

At least, two builds (https://github.com/apache/spark/runs/7500542538?check_suite_focus=true and https://github.com/apache/spark/runs/7511748355?check_suite_focus=true) passed after https://github.com/apache/spark/pull/37273. I assume that the number of partitions helps, and this PR increases some more.

### Does this PR introduce _any_ user-facing change?
No, test and dev-only.

### How was this patch tested?

It's tested in https://github.com/LuciferYang/spark/runs/7497163716?check_suite_focus=true

Closes #37286 from HyukjinKwon/SPARK-39856-follwup.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit 72b55ccf8327c00e173ab6130fdb428ad0d5aacc)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
1 parent aa53fca
History
Tip revision: 84ed6142ef5f4caa4ef94685a8fc5e0105231aea authored by Hyukjin Kwon on 26 July 2022, 06:03:17 UTC
[SPARK-39856][SQL][TESTS][FOLLOW-UP] Increase the number of partitions in TPC-DS build to avoid out-of-memory
Tip revision: 84ed614

README.md

back to top