https://github.com/apache/spark
Revision 550408e56c079a3e25b16c7ccc495216c9c7b9cf authored by Matt Molek on 16 November 2018, 16:00:21 UTC, committed by Sean Owen on 16 November 2018, 16:01:00 UTC
## What changes were proposed in this pull request?

Don't propagate SPARK_CONF_DIR to the driver in mesos cluster mode.

## How was this patch tested?

I built the 2.3.2 tag with this patch added and deployed a test job to a mesos cluster to confirm that the incorrect SPARK_CONF_DIR was no longer passed from the submit command.

Closes #22937 from mpmolek/fix-conf-dir.

Authored-by: Matt Molek <mpmolek@gmail.com>
Signed-off-by: Sean Owen <sean.owen@databricks.com>
(cherry picked from commit 696b75a81013ad61d25e0552df2b019c7531f983)
Signed-off-by: Sean Owen <sean.owen@databricks.com>
1 parent 7a59618
History
Tip revision: 550408e56c079a3e25b16c7ccc495216c9c7b9cf authored by Matt Molek on 16 November 2018, 16:00:21 UTC
[SPARK-25934][MESOS] Don't propagate SPARK_CONF_DIR from spark submit
Tip revision: 550408e

README.md

back to top