Revision 6a4e023b250a86887475958093f1d3bdcbb49a03 authored by Xiao Li on 01 June 2017, 16:52:18 UTC, committed by Xiao Li on 01 June 2017, 16:57:26 UTC
Before this PR, Subquery reuse does not work. Below are three issues:
- Subquery reuse does not work.
- It is sharing the same `SQLConf` (`spark.sql.exchange.reuse`) with the one for Exchange Reuse.
- No test case covers the rule Subquery reuse.

This PR is to fix the above three issues.
- Ignored the physical operator `SubqueryExec` when comparing two plans.
- Added a dedicated conf `spark.sql.subqueries.reuse` for controlling Subquery Reuse
- Added a test case for verifying the behavior

N/A

Author: Xiao Li <gatorsmile@gmail.com>

Closes #18169 from gatorsmile/subqueryReuse.

(cherry picked from commit f7cf2096fdecb8edab61c8973c07c6fc877ee32d)
Signed-off-by: Xiao Li <gatorsmile@gmail.com>
1 parent 4ab7b82
History
File Mode Size
create-release
deps
sparktestsupport
tests
.gitignore -rw-r--r-- 9 bytes
.rat-excludes -rw-r--r-- 1.7 KB
README.md -rw-r--r-- 197 bytes
appveyor-guide.md -rw-r--r-- 7.9 KB
appveyor-install-dependencies.ps1 -rw-r--r-- 3.7 KB
change-scala-version.sh -rwxr-xr-x 2.0 KB
change-version-to-2.10.sh -rwxr-xr-x 1018 bytes
change-version-to-2.11.sh -rwxr-xr-x 1018 bytes
check-license -rwxr-xr-x 2.5 KB
checkstyle-suppressions.xml -rw-r--r-- 2.3 KB
checkstyle.xml -rw-r--r-- 7.9 KB
github_jira_sync.py -rwxr-xr-x 5.2 KB
lint-java -rwxr-xr-x 1.2 KB
lint-python -rwxr-xr-x 3.9 KB
lint-r -rwxr-xr-x 1.3 KB
lint-r.R -rw-r--r-- 1.5 KB
lint-scala -rwxr-xr-x 920 bytes
make-distribution.sh -rwxr-xr-x 7.9 KB
merge_spark_pr.py -rwxr-xr-x 18.8 KB
mima -rwxr-xr-x 1.7 KB
pip-sanity-check.py -rw-r--r-- 1.4 KB
requirements.txt -rw-r--r-- 64 bytes
run-pip-tests -rwxr-xr-x 4.6 KB
run-tests -rwxr-xr-x 895 bytes
run-tests-jenkins -rwxr-xr-x 1.2 KB
run-tests-jenkins.py -rwxr-xr-x 8.9 KB
run-tests.py -rwxr-xr-x 23.1 KB
scalastyle -rwxr-xr-x 1.3 KB
test-dependencies.sh -rwxr-xr-x 3.7 KB
tox.ini -rw-r--r-- 848 bytes

README.md

back to top