0.2.2-0.1.0 • Published 5 years ago
@helm-charts/banzaicloud-stable-spark-hs v0.2.2-0.1.0
@helm-charts/banzaicloud-stable-spark-hs
A Helm chart for Spark HS in Kubernetes
| Field | Value |
|---|---|
| Repository Name | banzaicloud-stable |
| Chart Name | spark-hs |
| Chart Version | 0.2.2 |
| NPM Package Version | 0.1.0 |
# Default values for spark-hs
# This is a YAML-formatted file.
# Declare variables to be passed into your templates.
replicaCount: 1
image:
repository: banzaicloud/spark
tag: v2.3.2.146
pullPolicy: IfNotPresent
service:
externalPort: 80
internalPort: 18080
type: ClusterIP
resources:
# We usually recommend not to specify default resources and to leave this as a conscious
# choice for the user. This also increases chances charts run on environments with little
# resources, such as Minikube. If you do want to specify resources, uncomment the following
# lines, adjust them as necessary, and remove the curly braces after 'resources:'.
limits:
cpu: 500m
memory: 1024Mi
requests:
cpu: 500m
memory: 512Mi
nodeSelector: {}
tolerations: []
affinity: {}
ingress:
enabled: false
annotations:
{}
#kubernetes.io/ingress.class: traefik
#ingress.kubernetes.io/ssl-redirect: "false"
#traefik.frontend.rule.type: PathPrefix
hosts:
- '/'
# - "domain.com/xyz"
# - "domain.com"
tls: []
# - secretName: chart-example-tls
# hosts:
# - chart-example.local
sparkEventLogStorage:
cloudProvider: ''
logDirectory: ''
secretName: ''
awsAccessKeyId: ''
awsSecretAccessKey: ''
aliAccessKeyId: ''
aliSecretAccessKey: ''
aliOssEndpoint: ''
aliOssRegion: ''
azureStorageAccessKey: ''
azureStorageAccountName: ''
googleJson: ''
oracleRegion: ''
oracleHost: ''
apiKey: ''
oracleTenancyId: ''
oracleUserId: ''
oracleApiKeyFingerprint: ''Spark History Server Chart
SHS Spark History Server is the web UI for completed and running (aka incomplete) Spark applications. It is an extension of Spark’s web UI.
Chart Details
Installing the Chart
To install the chart:
$ helm install --set app.logDirectory=yourBucketName/eventLogFoloder,app.cloudProvider=amazon banzaicloud-stable/spark-hsConfiguration
The following tables lists the configurable parameters of the Spark History Sever chart and their default values.
| Parameter | Required | Description | Example |
|---|---|---|---|
| sparkEventLogStorage.logDirectory | yes | the URL to the directory containing application event logs to load | yourBucketName/eventLogFoloder |
| sparkEventLogStorage.cloudProvider | yes | the cloud provider where the objectstore/bucket located | amazongoogleazureoraclealibaba |
| sparkEventLogStorage.secretName | no | the name of K8s secret containing credentials for selected cloud provider. If no secretName is passed then there will be a secret created with the same structure populated from values. Checkout the required secret properties for each provider in next section below. | see below |
| sparkEventLogStorage.endpoint | no | the URL to the s3 endpoint you would like to read from (only valid for amazon cloudProvider) | http://172.1.1.1:9000 |
Structure of credential secret for each supported cloud provider
Amazon
AWS_ACCESS_KEY_ID: {{ .Values.sparkEventLogStorage.awsAccessKeyId | b64enc | quote }}
AWS_SECRET_ACCESS_KEY: {{ .Values.sparkEventLogStorage.awsSecretAccessKey | b64enc | quote }}Azure
storageAccount: {{ .Values.sparkEventLogStorage.azureStorageAccountName | b64enc | quote }}
accessKey: {{ .Values.sparkEventLogStorage.azureStorageAccessKey | b64enc | quote }}Alibaba
ALIBABA_ACCESS_KEY_ID: {{ .Values.sparkEventLogStorage.aliAccessKeyId | b64enc | quote }}
ALIBABA_ACCESS_KEY_SECRET: {{ .Values.sparkEventLogStorage.aliSecretAccessKey | b64enc | quote }}google.json: {{ .Values.sparkEventLogStorage.googleJson | quote }}Oracle
api_key: {{ .Values.sparkEventLogStorage.apiKey | b64enc | quote }}
tenancy_ocid: {{ .Values.sparkEventLogStorage.oracleTenancyId | b64enc | quote }}
user_ocid: {{ .Values.sparkEventLogStorage.oracleUserId | b64enc | quote }}
api_key_fingerprint: {{ .Values.sparkEventLogStorage.oracleApiKeyFingerprint | b64enc | quote }}0.2.2-0.1.0
5 years ago