spark-kubernetes-operator

Apache Spark Kubernetes Operator

Chainguard's redistribution of the spark-kubernetes-operator Helm chart, pre-configured with hardened Chainguard Images.

The Apache Spark Kubernetes Operator manages the lifecycle of Apache Spark applications and clusters (SparkApplication / SparkCluster custom resources) on Kubernetes.

Prerequisites

Authentication is required. First, authenticate with Chainguard:

chainctl auth login
chainctl auth configure-docker --pull-token --save
helm registry login cgr.dev

Create an image pull secret:

kubectl create secret docker-registry cgr-pull-secret \
  --docker-server=cgr.dev \
  --docker-username="$(echo cgr.dev | docker-credential-cgr get | jq -r '.Username')" \
  --docker-password="$(echo cgr.dev | docker-credential-cgr get | jq -r '.Secret')" \
  --namespace spark-operator

Installation

helm install spark-operator oci://cgr.dev/ORGANIZATION/charts/spark-kubernetes-operator \
  --namespace spark-operator \
  --create-namespace \
  --set imagePullSecrets[0].name=cgr-pull-secret

About This Chart

This is a redistribution of the upstream spark-kubernetes-operator. All upstream configuration options apply.

For full documentation, see: https://apache.github.io/spark-kubernetes-operator/