Revision 42cc830825e23addf891a1d1e9b14f0f588dd0a4 authored by lianhuiwang on 14 June 2017, 01:57:56 UTC, committed by Wenchen Fan on 14 June 2017, 01:58:16 UTC
## What changes were proposed in this pull request? After PruneFileSourcePartitions rule, It needs reset table's statistics because PruneFileSourcePartitions can filter some unnecessary partitions. So the statistics need to be changed. ## How was this patch tested? add unit test. Author: lianhuiwang <lianhuiwang09@gmail.com> Closes #18205 from lianhuiwang/SPARK-20986. (cherry picked from commit 8b5b2e272f48f7ddf8aeece0205cb4a5853c364e) Signed-off-by: Wenchen Fan <wenchen@databricks.com>
1 parent 53212c3
File | Mode | Size |
---|---|---|
docs | ||
lib | ||
pyspark | ||
test_support | ||
.gitignore | -rw-r--r-- | 49 bytes |
MANIFEST.in | -rw-r--r-- | 1.0 KB |
README.md | -rw-r--r-- | 1.8 KB |
pylintrc | -rw-r--r-- | 13.7 KB |
run-tests | -rwxr-xr-x | 899 bytes |
run-tests.py | -rwxr-xr-x | 8.3 KB |
setup.cfg | -rw-r--r-- | 854 bytes |
setup.py | -rw-r--r-- | 9.4 KB |
Computing file changes ...