https://github.com/apache/spark
Revision 86bf93e65481b8fe5d7532ca6d4cd29cafc9e9dd authored by Shixiong Zhu on 29 February 2016, 19:02:45 UTC, committed by Andrew Or on 11 May 2016, 18:29:06 UTC
## What changes were proposed in this pull request? Sometimes, network disconnection event won't be triggered for other potential race conditions that we may not have thought of, then the executor will keep sending heartbeats to driver and won't exit. This PR adds a new configuration `spark.executor.heartbeat.maxFailures` to kill Executor when it's unable to heartbeat to the driver more than `spark.executor.heartbeat.maxFailures` times. ## How was this patch tested? unit tests Author: Shixiong Zhu <shixiong@databricks.com> Closes #11401 from zsxwing/SPARK-13522.
1 parent c433c0a
Tip revision: 86bf93e65481b8fe5d7532ca6d4cd29cafc9e9dd authored by Shixiong Zhu on 29 February 2016, 19:02:45 UTC
[SPARK-13522][CORE] Executor should kill itself when it's unable to heartbeat to driver more than N times
[SPARK-13522][CORE] Executor should kill itself when it's unable to heartbeat to driver more than N times
Tip revision: 86bf93e
| File | Mode | Size |
|---|---|---|
| R | ||
| assembly | ||
| bagel | ||
| bin | ||
| build | ||
| conf | ||
| core | ||
| data | ||
| dev | ||
| docker | ||
| docker-integration-tests | ||
| docs | ||
| ec2 | ||
| examples | ||
| external | ||
| extras | ||
| graphx | ||
| launcher | ||
| licenses | ||
| mllib | ||
| network | ||
| project | ||
| python | ||
| repl | ||
| sbin | ||
| sbt | ||
| sql | ||
| streaming | ||
| tags | ||
| tools | ||
| unsafe | ||
| yarn | ||
| .gitattributes | -rw-r--r-- | 40 bytes |
| .gitignore | -rw-r--r-- | 1.1 KB |
| .rat-excludes | -rw-r--r-- | 1.2 KB |
| CHANGES.txt | -rw-r--r-- | 1.3 MB |
| CONTRIBUTING.md | -rw-r--r-- | 988 bytes |
| LICENSE | -rw-r--r-- | 16.9 KB |
| NOTICE | -rw-r--r-- | 23.0 KB |
| README.md | -rw-r--r-- | 3.3 KB |
| make-distribution.sh | -rwxr-xr-x | 8.4 KB |
| pom.xml | -rw-r--r-- | 89.7 KB |
| pylintrc | -rw-r--r-- | 13.7 KB |
| scalastyle-config.xml | -rw-r--r-- | 12.9 KB |
| tox.ini | -rw-r--r-- | 848 bytes |
Computing file changes ...
