Installation properties for Apache Livy on Amazon EMR on EKS releases
Apache Livy installation allows you to select a version of the Livy Helm chart. The Helm chart offers a variety of properties to customize your installation and setup experience. These properties are supported for Amazon EMR on EKS releases 7.1.0 and higher.
Amazon EMR 7.1.0 installation properties
The following table describes all of the supported Livy properties. When installing Apache Livy,
you can choose the Livy Helm chart version. To set a property during the installation, use the command
--set <property>=<value>
.
Property | Description | Default |
---|---|---|
image | The Amazon EMR release URI of the Livy server. This is a required configuration. | "" |
sparkNamespace | Namespace to run Livy Spark sessions. For example, specify "livy". This is a required configuration. | "" |
nameOverride | Provide a name instead of livy . The name is set as a label for all Livy resources |
"livy" |
fullnameOverride | Provide a name to use instead of the full names of resources. | "" |
ssl.enabled | Enables end-to-end SSL from Livy endpoint to Livy server. | FALSE |
ssl.certificateArn | If SSL is enabled, this is the ACM certificate ARN for the NLB created by the service.. | "" |
ssl.secretProviderClassName | If SSL is enabled, this is the secret provider class name to secure NLB for the Livy server connection with SSL. | "" |
ssl.keyStoreObjectName | If SSL is enabled, the object name for the keystore certificate in the secret provider class. | "" |
ssl.keyPasswordsObjectName | If SSL is enabled, the object name for the secret that has the keystore and key password. | "" |
rbac.create | If true, creates RBAC resources. | FALSE |
serviceAccount.create | If true, creates a Livy service account. | TRUE |
serviceAccount.name | The name of the service account to use for Livy. If you don't
set this property and create a service account, Amazon EMR on EKS automatically generates
a name using the fullname override property. |
"emr-containers-sa-livy" |
serviceAccount.executionRoleArn | The execution role ARN of the Livy service account. | "" |
sparkServiceAccount.create | IF true, creates the Spark service account in .Release.Namespace |
TRUE |
sparkServiceAccount.name | The name of the service account to use for Spark. If you don't set this property and
create a Spark service account, Amazon EMR on EKS automatically generates a name
with the fullnameOverride property with -spark-livy suffix. |
"emr-containers-sa-spark-livy" |
service.name | Name of the Livy service | "emr-containers-livy" |
service.annotations | Livy service annotations | {} |
loadbalancer.enabled | Whether to create a load balancer for the Livy service used to expose the Livy endpoint outside of the Amazon EKS cluster. | FALSE |
loadbalancer.internal | Whether to configure the Livy endpoint as internal to the VPC or external. Setting this property to |
FALSE |
imagePullSecrets | The list of imagePullSecret names to use to pull Livy image from private repositories. |
[] |
resources | The resource requests and limits for Livy containers. | {} |
nodeSelector | The nodes for which to schedule Livy pods. | {} |
tolerations | A list containing the Livy pods tolerations to define. | [] |
affinity | The Livy pods affinity rules. | {} |
persistence.enabled | If true, enables persistance for sesions directories. | FALSE |
persistence.subPath | The PVC subpath to mount to sessions directories. | "" |
persistence.existingClaim | The PVC to use instead of creating a new one. | {} |
persistence.storageClass | The storage class to use. To define this parameter, use the format
storageClassName: . Setting this parameter
to "-" disables dynamic provisioning. If you set this parameter to null or don't specify anything,
Amazon EMR on EKS doesn't set a storageClassName and uses the default provisioner. |
"" |
persistence.accessMode | The PVC access mode. | ReadWriteOnce |
persistence.size | The PVC size. | 20Gi |
persistence.annotations | Additional annotations for the PVC. | {} |
env.* | Additional envs to set to Livy container. For more information, see Inputting your own Livy and Spark configurations while installing Livy. | {} |
envFrom.* | Additional envs to set to Livy from a Kubernetes config map or secret. | [] |
livyConf.* | Additional livy.conf entries to set from a mounted Kubernetes config map or secret. | {} |
sparkDefaultsConf.* | Additional spark-defaults.conf entries to set from a mounted Kubernetes config map or secret. |
{} |