Spark Integration Hub K8s
Channel | Revision | Published | Runs on |
---|---|---|---|
latest/edge | 67 | 28 Jul 2025 | |
3/stable | 67 | 29 Jul 2025 | |
3/candidate | 67 | 28 Jul 2025 | |
3/beta | 67 | 28 Jul 2025 | |
3/edge | 73 | 22 Aug 2025 |
juju deploy spark-integration-hub-k8s --channel 3/stable
Deploy Kubernetes operators easily with Juju, the Universal Operator Lifecycle Manager. Need a Kubernetes cluster? Install MicroK8s to create a full CNCF-certified Kubernetes system in under 60 seconds.
Platform:
-
driver-pod-template | string
Define K8s driver pod from a file accessible to the
spark-submit
process. Ex.: "s3a://bucket/template.yml". Is equivalent to the following Spark configuration:spark.kubernetes.driver.podTemplateFile=<driver-pod-template>
-
enable-dynamic-allocation | boolean
Enable dynamic allocation of pods for autoscaling Spark jobs. Is equivalent to the following Spark configurations:
spark.dynamicAllocation.enabled=true spark.dynamicAllocation.shuffleTracking.enabled=true spark.dynamicAllocation.minExecutors=1
-
executor-pod-template | string
Define K8s executor pods from a file accessible to the
spark-submit
process. Ex.: "s3a://bucket/template.yml". Is equivalent to the following Spark configuration:spark.kubernetes.executor.podTemplateFile=<executor-pod-template>