Magics supported by Amazon Glue Ray interactive sessions
Magics for the Amazon Glue Jupyter kernel when it powers Ray interactive sessions are similar to those for the Spark sessions. For reference, see Configuring Amazon Glue interactive sessions for Jupyter and Amazon Glue Studio notebooks .
Sessions magics
Sessions magics are mostly the same as prior to the Amazon Glue for Ray preview. For more information about session magics outside of this preview, see Magics supported by Amazon Glue interactive sessions for Jupyter . We introduce a new magic to set the session type to Amazon Glue for Ray.
| Name | Type | Description |
|---|---|---|
%glue_ray
|
String | Changes the session type to Amazon Glue for Ray. |
Amazon Glue config magics
Magics to configure Amazon Glue in an interactive session may be different between session types. Currently, we only support this subset of existing magics when using Amazon Glue for Ray.
Warning
Known Issue: additional_python_modules
In the Ray interactive sessions preview, use of the additional_python_modules magic will
cause problems when saving your notebook. To configure python modules for Ray sessions, use
the %%configure magic to set the pip-install parameter defined in Using job parameters in Ray jobs.
| Name | Type | Description |
|---|---|---|
%%configure
|
Dictionary | Specify a JSON-formatted dictionary consisting of all configuration parameters for a session. Each parameter can be specified here or through individual magics. |
%iam_role |
String | Specify an IAM role ARN to execute your session with. Default from ~/.aws/configure |
%number_of_workers |
int | The number of workers of a defined worker_type that are allocated when a job runs.
worker_type must be set too. |
%worker_type |
String | In the Amazon Glue for Ray preview, the only supported worker type is Z.2X. |
%additional_python_modules |
List | Comma separated list of additional Python modules to include in your cluster (can be from Pypi or S3). |
Action magics
Amazon Glue Ray sessions do not support any action magics.