https://github.com/apache/spark
Revision fd053892c4f456c2ab6d4d8993704e3cc5013f13 authored by hyukjinkwon on 18 June 2016, 04:04:24 UTC, committed by Xiangrui Meng on 18 June 2016, 04:04:24 UTC
## What changes were proposed in this pull request? This PR backports https://github.com/apache/spark/pull/13619. The original test added in branch-2.0 was failed in branch-1.6. This seems because the behaviour was changed in https://github.com/apache/spark/commit/101663f1ae222a919fc40510aa4f2bad22d1be6f. This was failure while calculating Euler's number which ends up with a infinity regardless of this path. So, I brought the dataset from `AFTSurvivalRegressionExample` to make sure this is working and then wrote the test. I ran the test before/after creating empty partitions. `model.scale` becomes `1.0` with empty partitions and becames `1.547` without them. After this patch, this becomes always `1.547`. ## How was this patch tested? Unit test in `AFTSurvivalRegressionSuite`. Author: hyukjinkwon <gurwls223@gmail.com> Closes #13725 from HyukjinKwon/SPARK-15892-1-6.
1 parent e530823
Tip revision: fd053892c4f456c2ab6d4d8993704e3cc5013f13 authored by hyukjinkwon on 18 June 2016, 04:04:24 UTC
[SPARK-15892][ML] Backport correctly merging AFTAggregators to branch 1.6
[SPARK-15892][ML] Backport correctly merging AFTAggregators to branch 1.6
Tip revision: fd05389
File | Mode | Size |
---|---|---|
R | ||
assembly | ||
bagel | ||
bin | ||
build | ||
conf | ||
core | ||
data | ||
dev | ||
docker | ||
docker-integration-tests | ||
docs | ||
ec2 | ||
examples | ||
external | ||
extras | ||
graphx | ||
launcher | ||
licenses | ||
mllib | ||
network | ||
project | ||
python | ||
repl | ||
sbin | ||
sbt | ||
sql | ||
streaming | ||
tags | ||
tools | ||
unsafe | ||
yarn | ||
.gitattributes | -rw-r--r-- | 40 bytes |
.gitignore | -rw-r--r-- | 1.1 KB |
.rat-excludes | -rw-r--r-- | 1.2 KB |
CHANGES.txt | -rw-r--r-- | 1.3 MB |
CONTRIBUTING.md | -rw-r--r-- | 988 bytes |
LICENSE | -rw-r--r-- | 16.9 KB |
NOTICE | -rw-r--r-- | 23.0 KB |
README.md | -rw-r--r-- | 3.3 KB |
make-distribution.sh | -rwxr-xr-x | 8.4 KB |
pom.xml | -rw-r--r-- | 89.7 KB |
pylintrc | -rw-r--r-- | 13.7 KB |
scalastyle-config.xml | -rw-r--r-- | 12.9 KB |
tox.ini | -rw-r--r-- | 848 bytes |
![swh spinner](/static/img/swh-spinner.gif)
Computing file changes ...