https://github.com/apache/spark
Revision 2695b9213d590201cb9937736134e94a11f48ba2 authored by Shivaram Venkataraman on 06 November 2017, 16:58:42 UTC, committed by Shivaram Venkataraman on 06 November 2017, 16:58:55 UTC
## What changes were proposed in this pull request?

This PR adds a check between the R package version used and the version reported by SparkContext running in the JVM. The goal here is to warn users when they have a R package downloaded from CRAN and are using that to connect to an existing Spark cluster.

This is raised as a warning rather than an error as users might want to use patch versions interchangeably (e.g., 2.1.3 with 2.1.2 etc.)

## How was this patch tested?

Manually by changing the `DESCRIPTION` file

Author: Shivaram Venkataraman <shivaram@cs.berkeley.edu>

Closes #19624 from shivaram/sparkr-version-check.

(cherry picked from commit 65a8bf6036fe41a53b4b1e4298fa35d7fa4e9970)
Signed-off-by: Shivaram Venkataraman <shivaram@cs.berkeley.edu>
1 parent e35c53a
History
Tip revision: 2695b9213d590201cb9937736134e94a11f48ba2 authored by Shivaram Venkataraman on 06 November 2017, 16:58:42 UTC
[SPARK-22315][SPARKR] Warn if SparkR package version doesn't match SparkContext
Tip revision: 2695b92

README.md

back to top