https://github.com/apache/spark
Revision a64f600c62dc61bd13a4541c4fea41bf2ede16a9 authored by Jungtaek Lim on 28 December 2022, 11:51:09 UTC, committed by Jungtaek Lim on 28 December 2022, 12:02:25 UTC
This PR ports back #39245 to branch-3.3. This PR proposes to apply tree-pattern based pruning for the rule SessionWindowing, to minimize the evaluation of rule with SessionWindow node. The rule SessionWindowing is unnecessarily evaluated multiple times without proper pruning. No. Existing tests. Closes #39253 from HeartSaVioR/SPARK-41732-3.3. Authored-by: Jungtaek Lim <kabhwan.opensource@gmail.com> Signed-off-by: Jungtaek Lim <kabhwan.opensource@gmail.com> (cherry picked from commit 02a7fda304b39779bff7fe88f146ae106bd61f1a) Signed-off-by: Jungtaek Lim <kabhwan.opensource@gmail.com>
1 parent 5fef831
Tip revision: a64f600c62dc61bd13a4541c4fea41bf2ede16a9 authored by Jungtaek Lim on 28 December 2022, 11:51:09 UTC
[SPARK-41732][SQL][SS][3.3] Apply tree-pattern based pruning for the rule SessionWindowing
[SPARK-41732][SQL][SS][3.3] Apply tree-pattern based pruning for the rule SessionWindowing
Tip revision: a64f600
| File | Mode | Size |
|---|---|---|
| .github | ||
| .idea | ||
| R | ||
| assembly | ||
| bin | ||
| binder | ||
| build | ||
| common | ||
| conf | ||
| core | ||
| data | ||
| dev | ||
| docs | ||
| examples | ||
| external | ||
| graphx | ||
| hadoop-cloud | ||
| launcher | ||
| licenses | ||
| licenses-binary | ||
| mllib | ||
| mllib-local | ||
| project | ||
| python | ||
| repl | ||
| resource-managers | ||
| sbin | ||
| sql | ||
| streaming | ||
| tools | ||
| .asf.yaml | -rw-r--r-- | 1.1 KB |
| .gitattributes | -rw-r--r-- | 130 bytes |
| .gitignore | -rw-r--r-- | 1.8 KB |
| CONTRIBUTING.md | -rw-r--r-- | 997 bytes |
| LICENSE | -rw-r--r-- | 13.1 KB |
| LICENSE-binary | -rw-r--r-- | 22.3 KB |
| NOTICE | -rw-r--r-- | 2.0 KB |
| NOTICE-binary | -rw-r--r-- | 56.3 KB |
| README.md | -rw-r--r-- | 4.4 KB |
| appveyor.yml | -rw-r--r-- | 2.6 KB |
| pom.xml | -rw-r--r-- | 128.0 KB |
| scalastyle-config.xml | -rw-r--r-- | 21.0 KB |
Computing file changes ...
