https://github.com/apache/spark
Revision 57873ef693812e7d4e6fdba1adaade42d9fe74b0 authored by Aaron Davidson on 04 July 2014, 06:02:36 UTC, committed by Patrick Wendell on 04 July 2014, 06:02:56 UTC
JIRA: https://issues.apache.org/jira/browse/SPARK-2282 This issue is caused by a buildup of sockets in the TIME_WAIT stage of TCP, which is a stage that lasts for some period of time after the communication closes. This solution simply allows us to reuse sockets that are in TIME_WAIT, to avoid issues with the buildup of the rapid creation of these sockets. Author: Aaron Davidson <aaron@databricks.com> Closes #1220 from aarondav/SPARK-2282 and squashes the following commits: 2e5cab3 [Aaron Davidson] SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark (cherry picked from commit 97a0bfe1c0261384f09d53f9350de52fb6446d59) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
1 parent c37e9ed
Tip revision: 57873ef693812e7d4e6fdba1adaade42d9fe74b0 authored by Aaron Davidson on 04 July 2014, 06:02:36 UTC
SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark
SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark
Tip revision: 57873ef
| File | Mode | Size |
|---|---|---|
| assembly | ||
| bagel | ||
| bin | ||
| conf | ||
| core | ||
| data | ||
| dev | ||
| docker | ||
| docs | ||
| ec2 | ||
| examples | ||
| external | ||
| extras | ||
| graphx | ||
| mllib | ||
| project | ||
| python | ||
| repl | ||
| sbin | ||
| sbt | ||
| streaming | ||
| tools | ||
| yarn | ||
| .gitignore | -rw-r--r-- | 644 bytes |
| CHANGES.txt | -rw-r--r-- | 124.1 KB |
| LICENSE | -rw-r--r-- | 20.6 KB |
| NOTICE | -rw-r--r-- | 162 bytes |
| README.md | -rw-r--r-- | 3.8 KB |
| make-distribution.sh | -rwxr-xr-x | 5.0 KB |
| pom.xml | -rw-r--r-- | 24.9 KB |
Computing file changes ...
