Skip to main content

Browse the archive

Revision 972338ae771c99fc63acb5f75fdfa2f6d2c0ffab authored by Dongjoon Hyun on 27 June 2022, 08:29:57 UTC, committed by Dongjoon Hyun on 27 June 2022, 08:31:01 UTC 
[SPARK-39614][K8S] K8s pod name follows `DNS Subdomain Names` rule
 
This PR aims to fix a regression at Apache Spark 3.3.0 which doesn't allow long pod name prefix whose length is greater than 63.

Although Pod's `hostname` follows [DNS Label Names](https://kubernetes.io/docs/concepts/overview/working-with-objects/names/#dns-label-names), Pod name itself follows [DNS Subdomain Names](https://kubernetes.io/docs/concepts/overview/working-with-objects/names/#dns-subdomain-names) whose maximum length is 253.

Yes, this fixes a regression.

Pass the CIs with the updated unit tests.

Closes #36999 from dongjoon-hyun/SPARK-39614.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit c15508f0d6a49738db5edf7eb139cc1d438af9a9)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent 427148f
History
File Mode Size
LICENSE-AnchorJS.txt -rw-r--r-- 1.1 KB
LICENSE-CC0.txt -rw-r--r-- 6.9 KB
LICENSE-JLargeArrays.txt -rw-r--r-- 1.3 KB
LICENSE-JTransforms.txt -rw-r--r-- 1.3 KB
LICENSE-antlr.txt -rw-r--r-- 1.5 KB
LICENSE-arpack.txt -rw-r--r-- 1.5 KB
LICENSE-automaton.txt -rw-r--r-- 1.4 KB
LICENSE-blas.txt -rw-r--r-- 1.2 KB
LICENSE-bootstrap.txt -rw-r--r-- 1.1 KB
LICENSE-cloudpickle.txt -rw-r--r-- 1.6 KB
LICENSE-d3.min.js.txt -rw-r--r-- 1.4 KB
LICENSE-dagre-d3.txt -rw-r--r-- 1.0 KB
LICENSE-datatables.txt -rw-r--r-- 1.0 KB
LICENSE-dnsjava.txt -rw-r--r-- 1.3 KB
LICENSE-f2j.txt -rw-r--r-- 1.5 KB
LICENSE-graphlib-dot.txt -rw-r--r-- 1.0 KB
LICENSE-istack-commons-runtime.txt -rw-r--r-- 1.5 KB
LICENSE-jakarta-annotation-api -rw-r--r-- 13.9 KB
LICENSE-jakarta-ws-rs-api -rw-r--r-- 13.9 KB
LICENSE-jakarta.activation-api.txt -rw-r--r-- 1.5 KB
LICENSE-jakarta.xml.bind-api.txt -rw-r--r-- 1.5 KB
LICENSE-janino.txt -rw-r--r-- 1.6 KB
LICENSE-javassist.html -rw-r--r-- 25.1 KB
LICENSE-javax-transaction-transaction-api.txt -rw-r--r-- 16.4 KB
LICENSE-javolution.txt -rw-r--r-- 1.4 KB
LICENSE-jaxb-runtime.txt -rw-r--r-- 1.5 KB
LICENSE-jline.txt -rw-r--r-- 1.5 KB
LICENSE-jodd.txt -rw-r--r-- 1.3 KB
LICENSE-join.txt -rw-r--r-- 1.5 KB
LICENSE-jquery.txt -rw-r--r-- 1.1 KB
LICENSE-json-formatter.txt -rw-r--r-- 547 bytes
LICENSE-jsp-api.txt -rw-r--r-- 38.5 KB
LICENSE-kryo.txt -rw-r--r-- 1.5 KB
LICENSE-leveldbjni.txt -rw-r--r-- 1.4 KB
LICENSE-machinist.txt -rw-r--r-- 1.0 KB
LICENSE-matchMedia-polyfill.txt -rw-r--r-- 149 bytes
LICENSE-minlog.txt -rw-r--r-- 1.5 KB
LICENSE-modernizr.txt -rw-r--r-- 1.1 KB
LICENSE-mustache.txt -rw-r--r-- 1.2 KB
LICENSE-netlib.txt -rw-r--r-- 2.2 KB
LICENSE-paranamer.txt -rw-r--r-- 1.6 KB
LICENSE-pmml-model.txt -rw-r--r-- 1.5 KB
LICENSE-protobuf.txt -rw-r--r-- 2.1 KB
LICENSE-py4j.txt -rw-r--r-- 1.4 KB
LICENSE-pyrolite.txt -rw-r--r-- 1.3 KB
LICENSE-re2j.txt -rw-r--r-- 1.6 KB
LICENSE-reflectasm.txt -rw-r--r-- 1.5 KB
LICENSE-respond.txt -rw-r--r-- 1.0 KB
LICENSE-sbt-launch-lib.txt -rw-r--r-- 1.5 KB
LICENSE-scala.txt -rw-r--r-- 1.5 KB
LICENSE-scopt.txt -rw-r--r-- 1.1 KB
LICENSE-slf4j.txt -rw-r--r-- 1.1 KB
LICENSE-sorttable.js.txt -rw-r--r-- 937 bytes
LICENSE-spire.txt -rw-r--r-- 1.0 KB
LICENSE-vis-timeline.txt -rw-r--r-- 416 bytes
LICENSE-xmlenc.txt -rw-r--r-- 1.5 KB
LICENSE-zstd-jni.txt -rw-r--r-- 1.3 KB
LICENSE-zstd.txt -rw-r--r-- 1.5 KB
back to top