Amazon EMR on EKS 7.12.0 releases
This page describes the new and updated functionality for Amazon EMR that is specific to the Amazon EMR on EKS deployment. For details about Amazon EMR running on Amazon EC2 and about the Amazon EMR 7.12.0 release in general, see Amazon EMR 7.12.0 in the Amazon EMR Release Guide.
Amazon EMR on EKS 7.12 releases
The following Amazon EMR 7.12.0 releases are available for Amazon EMR on EKS. Select a specific emr-7.12.0-XXXX release to view more details such as the related container image tag.
Release notes
Release notes for Amazon EMR on EKS 7.12.0:
-
Supported applications ‐ Amazon SDK for Java 2.35.5 and 1.12.792, Apache Spark 3.5.6-amzn-1, Apache Hudi 1.0.2-amzn-1, Apache Iceberg 1.10.0-amzn-0, Delta 3.3.2-amzn-1, Apache Spark RAPIDS 25.04.0-amzn-0, Apache Flink 1.20.0-amzn-6
-
Supported components ‐
emr-ddb,emr-goodies,emr-s3-select,emrfs,hadoop-client,hudi,hudi-spark,iceberg,spark-kubernetes. -
Supported configuration classifications
For use with StartJobRun and CreateManagedEndpoint APIs:
Classifications Descriptions core-siteChange values in the
core-site.xmlHadoop file.emrfs-siteChange EMRFS settings.
spark-metricsChange values in the
metrics.propertiesSpark file.spark-defaultsChange values in the
spark-defaults.confSpark file.spark-envChange values in the Spark environment.
spark-hive-siteChange values in the
hive-site.xmlSpark file.spark-log4j2Change values in the
log4j2.propertiesSpark file.emr-job-submitterConfiguration for job submitter pod.
For use specifically with CreateManagedEndpoint APIs:
Classifications Descriptions jeg-configChange values in Jupyter Enterprise Gateway
jupyter_enterprise_gateway_config.pyfile.jupyter-kernel-overridesChange value for the Kernel Image in Jupyter Kernel Spec file.
Configuration classifications allow you to customize applications. These often correspond to a configuration XML file for the application, such as
spark-hive-site.xml. For more information, see Configure Applications.
Changes and features
The following features are included with the 7.12.0 release of Amazon EMR on EKS:
-
Iceberg Materialized Views – Starting EMR 7.12.0, EMR Spark supports creation and management of Iceberg Materialized Views (MV).
-
Hudi Full Table Access – Starting EMR 7.12.0, EMR now supports Full Table Access (FTA) control for Apache Hudi in Apache Spark based on your policies defined in Lake Formation. This feature enables read and write operations from your Amazon EMR Spark jobs on Lake Formation registered tables when the job role has full table access.
-
Iceberg version upgrade – EMR 7.12.0 supports Apache Iceberg version 1.10.
-
Logging for Livy interactive workloads – Starting EMR 7.12.0, EMR supports extensive logging for key system components to improve troubleshooting for Livy Spark job failures. This feature will provide EMR service with access to additional Livy and SecretAgent logs to simplify troubleshooting.