Revision 6a4e023b250a86887475958093f1d3bdcbb49a03 authored by Xiao Li on 01 June 2017, 16:52:18 UTC, committed by Xiao Li on 01 June 2017, 16:57:26 UTC
Before this PR, Subquery reuse does not work. Below are three issues:
- Subquery reuse does not work.
- It is sharing the same `SQLConf` (`spark.sql.exchange.reuse`) with the one for Exchange Reuse.
- No test case covers the rule Subquery reuse.

This PR is to fix the above three issues.
- Ignored the physical operator `SubqueryExec` when comparing two plans.
- Added a dedicated conf `spark.sql.subqueries.reuse` for controlling Subquery Reuse
- Added a test case for verifying the behavior

N/A

Author: Xiao Li <gatorsmile@gmail.com>

Closes #18169 from gatorsmile/subqueryReuse.

(cherry picked from commit f7cf2096fdecb8edab61c8973c07c6fc877ee32d)
Signed-off-by: Xiao Li <gatorsmile@gmail.com>
1 parent 4ab7b82
History
File Mode Size
docker.properties.template -rw-r--r-- 996 bytes
fairscheduler.xml.template -rw-r--r-- 1.1 KB
log4j.properties.template -rw-r--r-- 2.0 KB
metrics.properties.template -rw-r--r-- 7.1 KB
slaves.template -rw-r--r-- 865 bytes
spark-defaults.conf.template -rw-r--r-- 1.3 KB
spark-env.sh.template -rwxr-xr-x 3.6 KB

back to top