Setting up the Spark operator for Amazon EMR on EKS - Amazon EMR
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Setting up the Spark operator for Amazon EMR on EKS

Complete the following tasks to get set up before you install the Spark operator on Amazon EKS. If you've already signed up for Amazon Web Services (Amazon) and have used Amazon EKS, you are almost ready to use Amazon EMR on EKS. Complete the following tasks to get set up for the Spark operator on Amazon EKS. If you've already completed any of the prerequisites, you can skip those and move on to the next one.

  • Install the Amazon CLI – If you've already installed the Amazon CLI, confirm that you have the latest version.

  • Install eksctl – eksctl is a command line tool that you use to communicate with Amazon EKS.

  • Install Helm – The Helm package manager for Kubernetes helps you install and manage applications on your Kubernetes cluster.

  • Set up an Amazon EKS cluster – Follow the steps to create a new Kubernetes cluster with nodes in Amazon EKS.

  • Select an Amazon EMR base image URI (release 6.10.0 or higher) – the Spark operator is supported with Amazon EMR releases 6.10.0 and higher.