spark-integration-hub-k8s

Spark Integration Hub K8s

Channel Revision Published Runs on
latest/edge 67 28 Jul 2025
Ubuntu 22.04
3/stable 67 29 Jul 2025
Ubuntu 22.04
3/candidate 67 28 Jul 2025
Ubuntu 22.04
3/beta 67 28 Jul 2025
Ubuntu 22.04
3/edge 73 22 Aug 2025
Ubuntu 22.04
juju deploy spark-integration-hub-k8s --channel 3/stable
Show information

Platform:

Learn about configurations >

  • driver-pod-template | string

    Define K8s driver pod from a file accessible to the spark-submit process. Ex.: "s3a://bucket/template.yml". Is equivalent to the following Spark configuration:

    spark.kubernetes.driver.podTemplateFile=<driver-pod-template>

  • enable-dynamic-allocation | boolean

    Enable dynamic allocation of pods for autoscaling Spark jobs. Is equivalent to the following Spark configurations:

    spark.dynamicAllocation.enabled=true spark.dynamicAllocation.shuffleTracking.enabled=true spark.dynamicAllocation.minExecutors=1

  • executor-pod-template | string

    Define K8s executor pods from a file accessible to the spark-submit process. Ex.: "s3a://bucket/template.yml". Is equivalent to the following Spark configuration:

    spark.kubernetes.executor.podTemplateFile=<executor-pod-template>