Revision c59ad420b5fda29567f4a06b5f71df76e70e269a authored by Liang-Chi Hsieh on 24 May 2017, 16:35:40 UTC, committed by Wenchen Fan on 24 May 2017, 16:36:01 UTC
## What changes were proposed in this pull request? From JIRA: On each call to spark.read.parquet, a new ForkJoinPool is created. One of the threads in the pool is kept in the WAITING state, and never stopped, which leads to unbounded growth in number of threads. We should shutdown the pool after reading parquet files. ## How was this patch tested? Added a test to ParquetFileFormatSuite. Please review http://spark.apache.org/contributing.html before opening a pull request. Author: Liang-Chi Hsieh <viirya@gmail.com> Closes #18073 from viirya/SPARK-20848. (cherry picked from commit f72ad303f05a6d99513ea3b121375726b177199c) Signed-off-by: Wenchen Fan <wenchen@databricks.com>
1 parent 83aeac9
| File | Mode | Size |
|---|---|---|
| mvn | -rwxr-xr-x | 5.8 KB |
| sbt | -rwxr-xr-x | 5.3 KB |
| sbt-launch-lib.bash | -rwxr-xr-x | 5.0 KB |
| spark-build-info | -rwxr-xr-x | 1.5 KB |
Computing file changes ...
