https://github.com/apache/spark
Revision 57873ef693812e7d4e6fdba1adaade42d9fe74b0 authored by Aaron Davidson on 04 July 2014, 06:02:36 UTC, committed by Patrick Wendell on 04 July 2014, 06:02:56 UTC
JIRA: https://issues.apache.org/jira/browse/SPARK-2282 This issue is caused by a buildup of sockets in the TIME_WAIT stage of TCP, which is a stage that lasts for some period of time after the communication closes. This solution simply allows us to reuse sockets that are in TIME_WAIT, to avoid issues with the buildup of the rapid creation of these sockets. Author: Aaron Davidson <aaron@databricks.com> Closes #1220 from aarondav/SPARK-2282 and squashes the following commits: 2e5cab3 [Aaron Davidson] SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark (cherry picked from commit 97a0bfe1c0261384f09d53f9350de52fb6446d59) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
1 parent c37e9ed
Tip revision: 57873ef693812e7d4e6fdba1adaade42d9fe74b0 authored by Aaron Davidson on 04 July 2014, 06:02:36 UTC
SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark
SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark
Tip revision: 57873ef
File | Mode | Size |
---|---|---|
assembly | ||
bagel | ||
bin | ||
conf | ||
core | ||
data | ||
dev | ||
docker | ||
docs | ||
ec2 | ||
examples | ||
external | ||
extras | ||
graphx | ||
mllib | ||
project | ||
python | ||
repl | ||
sbin | ||
sbt | ||
streaming | ||
tools | ||
yarn | ||
.gitignore | -rw-r--r-- | 644 bytes |
CHANGES.txt | -rw-r--r-- | 124.1 KB |
LICENSE | -rw-r--r-- | 20.6 KB |
NOTICE | -rw-r--r-- | 162 bytes |
README.md | -rw-r--r-- | 3.8 KB |
make-distribution.sh | -rwxr-xr-x | 5.0 KB |
pom.xml | -rw-r--r-- | 24.9 KB |
![swh spinner](/static/img/swh-spinner.gif)
Computing file changes ...