Development endpoint workflow - Amazon Glue
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China.

Development endpoint workflow

To use an Amazon Glue development endpoint, you can follow this workflow:

  1. Create a development endpoint using the console or API. The endpoint is launched in a virtual private cloud (VPC) with your defined security groups.

  2. The console or API polls the development endpoint until it is provisioned and ready for work. When it's ready, connect to the development endpoint using one of the following methods to create and test Amazon Glue scripts.

    • Install an Apache Zeppelin notebook on your local machine, connect it to a development endpoint, and then develop on it using your browser.

    • Create a Zeppelin notebook server in its own Amazon EC2 instance in your account using the Amazon Glue console, and then connect to it using your browser. For more information about how to create a notebook server, see Creating a notebook server associated with a development endpoint.

    • Create an SageMaker notebook in your account using the Amazon Glue console. For more information about how to create a notebook, see Working with notebooks on the Amazon Glue console.

    • Open a terminal window to connect directly to a development endpoint.

    • If you have the professional edition of the JetBrains PyCharm Python IDE, connect it to a development endpoint and use it to develop interactively. If you insert pydevd statements in your script, PyCharm can support remote breakpoints.

  3. When you finish debugging and testing on your development endpoint, you can delete it.