Migrating from dev endpoints to interactive sessions - Amazon Glue
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Migrating from dev endpoints to interactive sessions

Use the following checklist to determine the appropriate method to migrate from dev endpoints to interactive sessions.

Does your script depend on Amazon Glue 0.9 or 1.0 specific features (for example, HDFS, YARN, etc.)?

If the answer is yes, see Migrating Amazon Glue jobs to Amazon Glue version 3.0. to learn how to migrate from Glue 0.9 or 1.0 to Glue 3.0 and later.

Which method do you use to access your dev endpoint?

If you use this method Then do this
SageMaker AI notebook, Jupyter notebook, or JupyterLab Migrate to Amazon Glue Studio notebook by downloading .ipynb files on Jupyter and create a new Amazon Glue Studio notebook job by uploading the .ipynb file. Alternatively, you can also use SageMaker AI Studio and select the Amazon Glue kernel.
Zeppelin notebook Convert the notebook to a Jupyter notebook manually by copying and pasting code or automatically using a third-party converter such as ze2nb. Then, use the notebook in Amazon Glue Studio notebook or SageMaker AI Studio.
IDE See Author Amazon Glue jobs with PyCharm using Amazon Glue interactive sessions, or Using interactive sessions with Microsoft Visual Studio Code.
REPL

Install the aws-glue-session package locally, then run the following command:

  • For Python: jupyter console --kernal glue_pyspark

  • For Scala: jupyter console --kernal glue_spark

SSH No corresponding option on interactive sessions. Alternatively, you can use a Docker image. To learn more, see Developing using a Docker image.