spark-operator
gfortetsanakis/spark-operator/helm
Terraform module for spark operator This module deploys the following helm chart on an Amazon EKS cluster: | Name | Repository | Version | | -------------- | ----------------------------------------------------------- | ------- | | spark-operator | https://googlecloudplatform.github.io/spark-on-k8s-operator | 1.1.25 | The module creates a service account for the spark operator configured with an IAM role with a policy that provides access to two S3 buckets, one for spark data and one for spark logs. All spark applications submitted with this service account will have access to the above buckets. The module also deploys a spark history server on the cluster from which the logs of completed spark applications will be accessible. Module input parameters | Parameter | Type | Description | | --
| Name | Type | Description | Default |
|---|---|---|---|
| namespace | string | The kubernetes namespace at which the spark operator chart will be deployed. | |
| eks_cluster_properties | string | A map variable containing properties of the EKS cluster. | |
| domain | string | The external DNS domain of the EKS cluster. | |
| certificate_issuer | string | The name of the certificate issuer that will be used to issue certificates for s | |
| spark_logs_bucket_name | string | The name of the S3 bucket at which logs of executed spark applications will be s | |
| history_server_spark_image | string | The spark image used for deploying the spark history server on the cluster. | |
| spark_data_bucket_name | string | The name of the S3 bucket at which spark will read and write data. | |
| node_selector | map | A map variable with nodeSelector labels applied when placing pods of the chart o | {} |
| spark_namespace | string | An optional namespace to be created for deploying spark application in the clust | "spark" |
spark_service_accountspark_history_server_urlspark_namespace