Amazon Glue version support policy - Amazon Glue
Support policy
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon Glue version support policy

Amazon Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. An Amazon Glue job contains the business logic that performs the data integration work in Amazon Glue. There are three types of jobs in Amazon Glue: Spark (batch and streaming), Ray and Python shell. When you define your job, you specify the Amazon Glue version, which configures versions in the underlying Spark, Ray or Python runtime environment. For example: an Amazon Glue version 5.0 Spark job supports Spark 3.5.4 and Python 3.11.

Support policy

Amazon Glue versions are built around a combination of operating system, programming language, and software libraries that are subject to maintenance and security updates. Amazon Glue's version support policy is to end support for a version when any major component of the version reaches the end of community long-term support (LTS) and security updates are no longer available. Amazon Glue's version support policy includes the following statuses:

End of Support (EOS) - When an Amazon Glue version reaches EOS:

  • Amazon Glue will no longer apply security patches or other updates to EOS versions.

  • Amazon Glue jobs on EOS versions are not eligible for technical support.

  • Amazon Glue may not honor SLAs when jobs are run on EOS versions.

End of Life (EOL) - When an Amazon Glue version reaches EOL:

  • You can no longer create new Amazon Glue jobs or interactive sessions on EOL versions.

  • You can no longer start job runs on these Amazon Glue versions.

  • Amazon Glue will stop existing job runs and interactive sessions on EOL versions.

  • EOL versions will be removed from Amazon Glue SDKs and APIs.

The following Amazon Glue versions have reached end of support and will no longer be available after the end of life date. Changes to a version’s support status start at midnight (Pacific time zone) on the specified date.

Type Glue version End of support End of life
Spark Glue version 0.9 (Spark 2.2, Scala 2, Python 2) 6/1/2022 4/1/2026
Spark Glue version 1.0 (Spark 2.4, Python 2) 6/1/2022 4/1/2026
Spark Glue version 1.0 (Spark 2.4, Scala 2, Python 3) 9/30/2022 4/1/2026
Spark Glue version 2.0 (Spark 2.4, Python 3) 1/31/2024 4/1/2026
Type Python version End of support End of life
Python shell Python 2 (Glue Version 1.0) 6/1/2022 4/1/2026
Python shell PythonShell 3.6 (Glue version 1.0) 3/31/2026 NA
Type Notebook version End of support End of life
Development endpoint Zeppelin notebook 9/30/2022 NA

Amazon strongly recommends that you migrate your jobs to supported versions.

For information on migrating your Spark jobs to the latest Amazon Glue version, see Migrating Amazon Glue jobs to Amazon Glue version 5.0.

For migrating your Python shell jobs to the latest Amazon Glue version:

  • In the console, choose Python 3 (Glue Version 4.0).

  • In the CreateJob/UpdateJob API, set the GlueVersion parameter to 2.0, and the PythonVersion to 3 under the Command parameter. The GlueVersion configuration does not affect the behavior of Python shell jobs, so there is no advantage to incrementing GlueVersion.

  • You need to make your job script compatible with Python 3.