Development endpoints
Note
The console experience for dev endpoints has been removed as of
March 31, 2023. Creating, updating, and monitoring dev endpoints is still
available via the Development endpoints API and
Amazon Glue CLI
We strongly recommend migrating from dev endpoints to interactive sessions for the reasons listed below. For required actions on how to migrate from dev endpoints to interactive sessions, see Migrating from dev endpoints to interactive sessions.
| Description | Dev endpoints | Interactive sessions |
|---|---|---|
| Glue version support | Supports Amazon Glue version 0.9 and 1.0 | Supports Amazon Glue version 2.0 and later |
Dev endpoints are not available in the Asia Pacific (Jakarta) (ap-southeast-3),
Middle East (UAE) (me-central-1), Europe (Spain) (eu-south-2), Europe (Zurich) (eu-central-2),
or other new regions going forward |
Interactive sessions are not currently available in the Middle East (UAE) (me-central-1) region, but may be made available later |
|
| Access method to the Spark cluster | Supports SSH, REPL shell, Jupyter notebook, IDE (e.g. PyCharm) | supports Amazon Glue Studio notebook, Jupyter notebook, various IDEs (for example, Visual Studio Code, PyCharm), and SageMaker AI notebook |
| Time to first query | Requires 10-15 minutes to setup a Spark cluster | Can take up to 1 minute to set up an ephemeral Spark cluster |
| Price model | Amazon charges for development endpoints based on the time that the endpoint is provisioned and the number of DPUs. Development endpoints do not time out. There is a 10-minute minimum billing duration for each provisioned development endpoint. Additionally, Amazon charges for Jupyter notebook on Amazon EC2 instances, and SageMaker AI notebooks when you configure them with dev endpoints. | Amazon charges for interactive sessions based on the time that the session is active and the number of DPUs. interactive sessions have configurable idle timeouts. Amazon Glue Studio notebooks provide a built-in interface for interactive sessions and are offered at no additional cost. There is a 1-minute minimum billing duration for each interactive session. Amazon Glue Studio notebooks provide a built-in interface for interactive sessions and are offered at no additional cost |
| Console experience | Only available via the CLI and API | Available through the Amazon Glue console, CLI, and APIs |
The following sections provide information on using dev endpoints to develop jobs in Amazon Glue version 1.0.