Magics supported by Amazon Glue Ray interactive sessions - Amazon Glue
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Magics supported by Amazon Glue Ray interactive sessions

Magics for the Amazon Glue Jupyter kernel when it powers Ray interactive sessions are similar to those for the Spark sessions. For reference, see Configuring Amazon Glue interactive sessions for Jupyter and Amazon Glue Studio notebooks .

Sessions magics

Sessions magics are mostly the same as prior to the Amazon Glue for Ray preview. For more information about session magics outside of this preview, see Magics supported by Amazon Glue interactive sessions for Jupyter. We introduce a new magic to set the session type to Amazon Glue for Ray.

Name Type Description
%glue_ray String Changes the session type to Amazon Glue for Ray.

Amazon Glue config magics

Magics to configure Amazon Glue in an interactive session may be different between session types. Currently, we only support this subset of existing magics when using Amazon Glue for Ray.

Warning

Known Issue: additional_python_modules

In the Ray interactive sessions preview, use of the additional_python_modules magic will cause problems when saving your notebook. To configure python modules for Ray sessions, use the %%configure magic to set the pip-install parameter defined in Using job parameters in Ray jobs.

Name Type Description
%%configure Dictionary Specify a JSON-formatted dictionary consisting of all configuration parameters for a session. Each parameter can be specified here or through individual magics.
%iam_role String Specify an IAM role ARN to execute your session with. Default from ~/.aws/configure
%number_of_workers int The number of workers of a defined worker_type that are allocated when a job runs. worker_type must be set too.
%worker_type String In the Amazon Glue for Ray preview, the only supported worker type is Z.2X.
%additional_python_modules List Comma separated list of additional Python modules to include in your cluster (can be from Pypi or S3).

Action magics

Amazon Glue Ray sessions do not support any action magics.