Amazon EMR on EKS 6.3.0 releases
The following Amazon EMR 6.3.0 releases are available for Amazon EMR on EKS. Select a specific emr-6.3.0-XXXX release to view more details such as the related container image tag.
Release notes for Amazon EMR 6.3.0
-
New features ‐ Beginning with Amazon EMR 6.3.0 in the 6.x release series, Amazon EMR on EKS supports Spark’s pod template feature. You can also turn on the Spark event log rotation feature for Amazon EMR on EKS. For more information, see Using pod templates and Using Spark event log rotation.
-
Supported applications ‐ Spark 3.1.1-amzn-0, Jupyter Enterprise Gateway (endpoints, public preview).
-
Supported components ‐
aws-hm-client
(Glue connector),aws-sagemaker-spark-sdk
,emr-s3-select
,emrfs
,emr-ddb
,hudi-spark
. -
Supported configuration classifications:
Classifications Descriptions core-site
Change values in Hadoop’s core-site.xml file.
emrfs-site
Change EMRFS settings.
spark-metrics
Change values in Spark's metrics.properties file.
spark-defaults
Change values in Spark's spark-defaults.conf file.
spark-env
Change values in the Spark environment.
spark-hive-site
Change values in Spark's hive-site.xml file.
spark-log4j
Change values in Spark's log4j.properties file.
Configuration classifications allow you to customize applications. These often correspond to a configuration XML file for the application, such as spark-hive-site.xml. For more information, see Configuring Applications.