Amazon EMR 6.6.0 - Hadoop release notes - Amazon EMR
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon EMR 6.6.0 - Hadoop release notes

Amazon EMR 6.6.0 - Hadoop changes

Type Description
Bug Fixed duplicated records when reading BZip2 text files.
Backport HADOOP-18136: Verify FileUtils.unTar() handling of missing .tar files
Backport HADOOP-17627: Backport to branch-3.2 HADOOP-17371, HADOOP-17621, HADOOP-17625 to update Jetty to 9.4.39
Backport HADOOP-17655: Upgrade Jetty to 9.4.40
Backport HADOOP-17796: Upgrade jetty version to 9.4.43
Backport HADOOP-17661: mvn versions:set fails to parse pom.xml
Backport HADOOP-17236: Bump up snakeyaml to 1.26 to mitigate CVE-2017-18640
Backport HADOOP-16717: Remove GenericsUtil isLog4jLogger dependency on Log4jLoggerAdapter
Backport HADOOP-17633: Bump json-smart to 2.4.2 and nimbus-jose-jwt to 9.8 due to CVEs
Backport HADOOP-17844: Upgrade JSON smart to 2.4.7
Backport HADOOP-17972: Backport HADOOP-17683 (Update commons-io to 2.8.0) for branch-3.2
Backport HADOOP-16555: Update commons-compress to 1.19
Backport HADOOP-17370: Upgrade commons-compress to 1.21
Backport HADOOP-17096: Fix ZStandardCompressor input buffer offset
Backport HADOOP-17112: Whitespace not allowed in paths when saving files to s3a via committer
Backport HADOOP-13500: Synchronizing iteration of Configuration properties object
Backport HDFS-14099: Unknown frame descriptor when decompressing multiple frames in ZStandardDecompressor
Backport HDFS-16410: Insecure Xml parsing in OfflineEditsXmlLoader
Backport HDFS-14498: LeaseManager can loop forever on the file for which create has failed
Backport HDFS-15290: NPE in HttpServer during NameNode startup
Backport HDFS-15293: Relax the condition for accepting a fsimage when receiving a checkpoint
Backport HDFS-12979: StandbyNode should upload FsImage to ObserverNode after checkpointing
Backport YARN-10538: Add recommissioning nodes to the list of updated nodes returned to the AM
Backport YARN-10472: Backport YARN-10314 (YarnClient throws NoClassDefFoundError for WebSocketException with only shaded client jars) to branch-3.2
Backport YARN-9968: Public Localizer is exiting in NodeManager due to NullPointerException
Backport YARN-10651: CapacityScheduler crashed with NPE in AbstractYarnScheduler.updateNodeResource()
Backport YARN-9339: Apps pending metric incorrect after moving app to a new queue
Backport YARN-10438: Handle null containerId in ClientRMService#getContainerReport()
Backport YARN-7266: ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing
Backport YARN-9063: ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing
Backport YARN-9848: Revert YARN-4946 (RM should not consider an application as COMPLETED when log aggregation is not in a terminal state).