Revision 02cf178bb2a7dc8b4c06eb040c44b6453e41ed15 authored by Mark Grover on 08 June 2017, 16:55:43 UTC, committed by Marcelo Vanzin on 08 June 2017, 16:55:54 UTC
## What changes were proposed in this pull request?

Add a new property `spark.streaming.kafka.consumer.cache.enabled` that allows users to enable or disable the cache for Kafka consumers. This property can be especially handy in cases where issues like SPARK-19185 get hit, for which there isn't a solution committed yet. By default, the cache is still on, so this change doesn't change any out-of-box behavior.

## How was this patch tested?
Running unit tests

Author: Mark Grover <mark@apache.org>
Author: Mark Grover <grover.markgrover@gmail.com>

Closes #18234 from markgrover/spark-19185.

(cherry picked from commit 55b8cfe6e6a6759d65bf219ff570fd6154197ec4)
Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
1 parent 2f5eaa9
History

README.md

back to top