View Application History - Amazon EMR
AWS 文档中描述的 AWS 服务或功能可能因区域而异。要查看适用于中国区域的差异,请参阅中国的 AWS 服务入门


View Application History

您可以在控制台中使用集群详细信息页面的 Application user interfaces (应用程序用户界面) 选项卡查看 Spark 历史记录服务器和 YARN 时间线服务应用程序的详细信息。Amazon EMR 应用程序历史记录使您能够更轻松地分析活动的作业和作业历史记录并排查其问题。

Application user interfaces (应用程序用户界面) 选项卡提供多个查看选项:

  • Off-cluster access to persistent application user interfaces – Starting with Amazon EMR version 5.25.0, persistent application user interface links are available for Spark. With Amazon EMR version 6.0.0 and later, Tez UI and the YARN timeline server also have persistent application user interfaces. The YARN timeline server and Tez UI are open-source applications that provide metrics for active and terminated clusters. The Spark user interface provides details about scheduler stages and tasks, RDD sizes and memory usage, environmental information, and information about the running executors. Persistent application UIs are run off-cluster, so cluster information and logs are available for 30 days after an application terminates. Unlike on-cluster application user interfaces, persistent application UIs don't require you to set up a web proxy through a SSH connection.

  • On-cluster application user interfaces – There are a variety of application history user interfaces that can be run on a cluster. On-cluster user interfaces are hosted on the master node and require you to set up a SSH connection to the web server. On-cluster application user interfaces keep application history for one week after an application terminates.

  • High-level application history – With Amazon EMR version 5.8.0 or later, you can view a summary of application history in the EMR console, including key metrics for stage tasks and executors. The summary of the application history is available for all YARN applications. Additional details are provided for Spark applications, but these details are only a subset of the information available through the Spark application UI.