Skip to main content

Browse the archive

Revision 6a4e023b250a86887475958093f1d3bdcbb49a03 authored by Xiao Li on 01 June 2017, 16:52:18 UTC, committed by Xiao Li on 01 June 2017, 16:57:26 UTC 
[SPARK-20941][SQL] Fix SubqueryExec Reuse
 
Before this PR, Subquery reuse does not work. Below are three issues:
- Subquery reuse does not work.
- It is sharing the same `SQLConf` (`spark.sql.exchange.reuse`) with the one for Exchange Reuse.
- No test case covers the rule Subquery reuse.

This PR is to fix the above three issues.
- Ignored the physical operator `SubqueryExec` when comparing two plans.
- Added a dedicated conf `spark.sql.subqueries.reuse` for controlling Subquery Reuse
- Added a test case for verifying the behavior

N/A

Author: Xiao Li <gatorsmile@gmail.com>

Closes #18169 from gatorsmile/subqueryReuse.

(cherry picked from commit f7cf2096fdecb8edab61c8973c07c6fc877ee32d)
Signed-off-by: Xiao Li <gatorsmile@gmail.com>
1 parent 4ab7b82
History
File Mode Size
LICENSE-AnchorJS.txt -rw-r--r-- 1.1 KB
LICENSE-DPark.txt -rw-r--r-- 1.5 KB
LICENSE-Mockito.txt -rw-r--r-- 1.1 KB
LICENSE-SnapTree.txt -rw-r--r-- 1.7 KB
LICENSE-antlr.txt -rw-r--r-- 1.5 KB
LICENSE-boto.txt -rw-r--r-- 1.0 KB
LICENSE-cloudpickle.txt -rw-r--r-- 1.6 KB
LICENSE-d3.min.js.txt -rw-r--r-- 1.4 KB
LICENSE-dagre-d3.txt -rw-r--r-- 1.0 KB
LICENSE-f2j.txt -rw-r--r-- 1.5 KB
LICENSE-graphlib-dot.txt -rw-r--r-- 1.0 KB
LICENSE-heapq.txt -rw-r--r-- 14.2 KB
LICENSE-javolution.txt -rw-r--r-- 1.4 KB
LICENSE-jbcrypt.txt -rw-r--r-- 836 bytes
LICENSE-jline.txt -rw-r--r-- 1.5 KB
LICENSE-jpmml-model.txt -rw-r--r-- 1.5 KB
LICENSE-jquery.txt -rw-r--r-- 1.1 KB
LICENSE-junit-interface.txt -rw-r--r-- 1.3 KB
LICENSE-kryo.txt -rw-r--r-- 1.5 KB
LICENSE-minlog.txt -rw-r--r-- 1.5 KB
LICENSE-modernizr.txt -rw-r--r-- 1.1 KB
LICENSE-netlib.txt -rw-r--r-- 2.2 KB
LICENSE-paranamer.txt -rw-r--r-- 1.6 KB
LICENSE-postgresql.txt -rw-r--r-- 1.2 KB
LICENSE-protobuf.txt -rw-r--r-- 2.1 KB
LICENSE-py4j.txt -rw-r--r-- 1.4 KB
LICENSE-pyrolite.txt -rw-r--r-- 1.3 KB
LICENSE-reflectasm.txt -rw-r--r-- 1.5 KB
LICENSE-sbt-launch-lib.txt -rw-r--r-- 1.5 KB
LICENSE-scala.txt -rw-r--r-- 1.5 KB
LICENSE-scalacheck.txt -rw-r--r-- 1.5 KB
LICENSE-scopt.txt -rw-r--r-- 1.1 KB
LICENSE-slf4j.txt -rw-r--r-- 1.1 KB
LICENSE-sorttable.js.txt -rw-r--r-- 937 bytes
LICENSE-spire.txt -rw-r--r-- 1.0 KB
LICENSE-xmlenc.txt -rw-r--r-- 1.5 KB
back to top