https://github.com/apache/spark
Revision fd053892c4f456c2ab6d4d8993704e3cc5013f13 authored by hyukjinkwon on 18 June 2016, 04:04:24 UTC, committed by Xiangrui Meng on 18 June 2016, 04:04:24 UTC
## What changes were proposed in this pull request? This PR backports https://github.com/apache/spark/pull/13619. The original test added in branch-2.0 was failed in branch-1.6. This seems because the behaviour was changed in https://github.com/apache/spark/commit/101663f1ae222a919fc40510aa4f2bad22d1be6f. This was failure while calculating Euler's number which ends up with a infinity regardless of this path. So, I brought the dataset from `AFTSurvivalRegressionExample` to make sure this is working and then wrote the test. I ran the test before/after creating empty partitions. `model.scale` becomes `1.0` with empty partitions and becames `1.547` without them. After this patch, this becomes always `1.547`. ## How was this patch tested? Unit test in `AFTSurvivalRegressionSuite`. Author: hyukjinkwon <gurwls223@gmail.com> Closes #13725 from HyukjinKwon/SPARK-15892-1-6.
1 parent e530823
Tip revision: fd053892c4f456c2ab6d4d8993704e3cc5013f13 authored by hyukjinkwon on 18 June 2016, 04:04:24 UTC
[SPARK-15892][ML] Backport correctly merging AFTAggregators to branch 1.6
[SPARK-15892][ML] Backport correctly merging AFTAggregators to branch 1.6
Tip revision: fd05389
| File | Mode | Size |
|---|---|---|
| R | ||
| assembly | ||
| bagel | ||
| bin | ||
| build | ||
| conf | ||
| core | ||
| data | ||
| dev | ||
| docker | ||
| docker-integration-tests | ||
| docs | ||
| ec2 | ||
| examples | ||
| external | ||
| extras | ||
| graphx | ||
| launcher | ||
| licenses | ||
| mllib | ||
| network | ||
| project | ||
| python | ||
| repl | ||
| sbin | ||
| sbt | ||
| sql | ||
| streaming | ||
| tags | ||
| tools | ||
| unsafe | ||
| yarn | ||
| .gitattributes | -rw-r--r-- | 40 bytes |
| .gitignore | -rw-r--r-- | 1.1 KB |
| .rat-excludes | -rw-r--r-- | 1.2 KB |
| CHANGES.txt | -rw-r--r-- | 1.3 MB |
| CONTRIBUTING.md | -rw-r--r-- | 988 bytes |
| LICENSE | -rw-r--r-- | 16.9 KB |
| NOTICE | -rw-r--r-- | 23.0 KB |
| README.md | -rw-r--r-- | 3.3 KB |
| make-distribution.sh | -rwxr-xr-x | 8.4 KB |
| pom.xml | -rw-r--r-- | 89.7 KB |
| pylintrc | -rw-r--r-- | 13.7 KB |
| scalastyle-config.xml | -rw-r--r-- | 12.9 KB |
| tox.ini | -rw-r--r-- | 848 bytes |
Computing file changes ...
