https://github.com/apache/spark
Revision 910bfc87b2462cecc502782cf427ccdd0a1bc966 authored by Marco Gaido on 05 December 2018, 17:09:47 UTC, committed by Dongjoon Hyun on 05 December 2018, 17:09:47 UTC
## What changes were proposed in this pull request? When we encode a Decimal from external source we don't check for overflow. That method is useful not only in order to enforce that we can represent the correct value in the specified range, but it also changes the underlying data to the right precision/scale. Since in our code generation we assume that a decimal has exactly the same precision and scale of its data type, missing to enforce it can lead to corrupted output/results when there are subsequent transformations. ## How was this patch tested? added UT Closes #23232 from mgaido91/SPARK-26233_2.4. Authored-by: Marco Gaido <marcogaido91@gmail.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent c9fd14c
Tip revision: 910bfc87b2462cecc502782cf427ccdd0a1bc966 authored by Marco Gaido on 05 December 2018, 17:09:47 UTC
[SPARK-26233][SQL][BACKPORT-2.4] CheckOverflow when encoding a decimal value
[SPARK-26233][SQL][BACKPORT-2.4] CheckOverflow when encoding a decimal value
Tip revision: 910bfc8
| File | Mode | Size |
|---|---|---|
| .github | ||
| R | ||
| assembly | ||
| bin | ||
| build | ||
| common | ||
| conf | ||
| core | ||
| data | ||
| dev | ||
| docs | ||
| examples | ||
| external | ||
| graphx | ||
| hadoop-cloud | ||
| launcher | ||
| licenses | ||
| licenses-binary | ||
| mllib | ||
| mllib-local | ||
| project | ||
| python | ||
| repl | ||
| resource-managers | ||
| sbin | ||
| sql | ||
| streaming | ||
| tools | ||
| .gitattributes | -rw-r--r-- | 40 bytes |
| .gitignore | -rw-r--r-- | 1.3 KB |
| CONTRIBUTING.md | -rw-r--r-- | 995 bytes |
| LICENSE | -rw-r--r-- | 13.0 KB |
| LICENSE-binary | -rw-r--r-- | 20.9 KB |
| NOTICE | -rw-r--r-- | 1.5 KB |
| NOTICE-binary | -rw-r--r-- | 41.9 KB |
| README.md | -rw-r--r-- | 3.9 KB |
| appveyor.yml | -rw-r--r-- | 2.2 KB |
| pom.xml | -rw-r--r-- | 100.4 KB |
| scalastyle-config.xml | -rw-r--r-- | 18.0 KB |
Computing file changes ...
