Developing scripts using development endpoints - Amazon Glue
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China.

Developing scripts using development endpoints

Amazon Glue can create an environment—known as a development endpoint—that you can use to iteratively develop and test your extract, transform, and load (ETL) scripts. You can create, edit, and delete development endpoints using the Amazon Glue console or API.

Note

Development endpoints are not supported for use with Amazon Glue version 2.0 jobs. For more information, see Running Spark ETL Jobs with Reduced Startup Times.

Managing your development environment

When you create a development endpoint, you provide configuration values to provision the development environment. These values tell Amazon Glue how to set up the network so that you can access the endpoint securely and the endpoint can access your data stores.

You can then create a notebook that connects to the endpoint, and use your notebook to author and test your ETL script. When you're satisfied with the results of your development process, you can create an ETL job that runs your script. With this process, you can add functions and debug your scripts in an interactive manner.

Follow the tutorials in this section to learn how to use your development endpoint with notebooks.