Revision fdea642dbd17d74c8bf136c1746159acaa937d25 authored by donnyzone on 18 August 2017, 05:37:32 UTC, committed by gatorsmile on 18 August 2017, 05:37:41 UTC
## What changes were proposed in this pull request? https://issues.apache.org/jira/projects/SPARK/issues/SPARK-21739 This issue is caused by introducing TimeZoneAwareExpression. When the **Cast** expression converts something into TimestampType, it should be resolved with setting `timezoneId`. In general, it is resolved in LogicalPlan phase. However, there are still some places that use Cast expression statically to convert datatypes without setting `timezoneId`. In such cases, `NoSuchElementException: None.get` will be thrown for TimestampType. This PR is proposed to fix the issue. We have checked the whole project and found two such usages(i.e., in`TableReader` and `HiveTableScanExec`). ## How was this patch tested? unit test Author: donnyzone <wellfengzhu@gmail.com> Closes #18960 from DonnyZone/spark-21739. (cherry picked from commit 310454be3b0ce5ff6b6ef0070c5daadf6fb16927) Signed-off-by: gatorsmile <gatorsmile@gmail.com>
1 parent 2a96975
| File | Mode | Size |
|---|---|---|
| beeline | -rwxr-xr-x | 1.1 KB |
| beeline.cmd | -rw-r--r-- | 899 bytes |
| find-spark-home | -rwxr-xr-x | 1.9 KB |
| load-spark-env.cmd | -rw-r--r-- | 1.9 KB |
| load-spark-env.sh | -rw-r--r-- | 2.1 KB |
| pyspark | -rwxr-xr-x | 2.9 KB |
| pyspark.cmd | -rw-r--r-- | 1002 bytes |
| pyspark2.cmd | -rw-r--r-- | 1.5 KB |
| run-example | -rwxr-xr-x | 1.0 KB |
| run-example.cmd | -rw-r--r-- | 988 bytes |
| spark-class | -rwxr-xr-x | 3.1 KB |
| spark-class.cmd | -rw-r--r-- | 1012 bytes |
| spark-class2.cmd | -rw-r--r-- | 2.4 KB |
| spark-shell | -rwxr-xr-x | 2.9 KB |
| spark-shell.cmd | -rw-r--r-- | 1010 bytes |
| spark-shell2.cmd | -rw-r--r-- | 1.5 KB |
| spark-sql | -rwxr-xr-x | 1.0 KB |
| spark-submit | -rwxr-xr-x | 1.0 KB |
| spark-submit.cmd | -rw-r--r-- | 1012 bytes |
| spark-submit2.cmd | -rw-r--r-- | 1.1 KB |
| sparkR | -rwxr-xr-x | 1.0 KB |
| sparkR.cmd | -rw-r--r-- | 1000 bytes |
| sparkR2.cmd | -rw-r--r-- | 1014 bytes |
Computing file changes ...
