https://github.com/apache/spark
Revision e35c53a976b283d9554ef61685eddf58649104fd authored by Tristan Stevens on 05 November 2017, 09:10:40 UTC, committed by Sean Owen on 05 November 2017, 09:10:51 UTC
## What changes were proposed in this pull request?

SPARK-14930/SPARK-13693 put in a change to set the fs object to null after a failure, however the retry loop does not include initialization. Moved fs initialization inside the retry while loop to aid recoverability.

## How was this patch tested?

Passes all existing unit tests.

Author: Tristan Stevens <tristan@cloudera.com>

Closes #19645 from tmgstevens/SPARK-22429.

(cherry picked from commit fe258a7963361c1f31bc3dc3a2a2ee4a5834bb58)
Signed-off-by: Sean Owen <sowen@cloudera.com>
1 parent 5e38373
History
Tip revision: e35c53a976b283d9554ef61685eddf58649104fd authored by Tristan Stevens on 05 November 2017, 09:10:40 UTC
[SPARK-22429][STREAMING] Streaming checkpointing code does not retry after failure
Tip revision: e35c53a

README.md

back to top