Class GlueVersion
(experimental) AWS Glue version determines the versions of Apache Spark and Python that are available to the job.
Inheritance
Namespace: Amazon.CDK.AWS.Glue.Alpha
Assembly: Amazon.CDK.AWS.Glue.Alpha.dll
Syntax (csharp)
public class GlueVersion : DeputyBase
Syntax (vb)
Public Class GlueVersion
Inherits DeputyBase
Remarks
Stability: Experimental
See: https://docs.aws.amazon.com/glue/latest/dg/add-job.html.
If you need to use a GlueVersion that doesn't exist as a static member, you
can instantiate a GlueVersion
object, e.g: GlueVersion.of('1.5')
.
ExampleMetadata: infused
Examples
new Job(this, "EnableSparkUI", new JobProps {
JobName = "EtlJobWithSparkUIPrefix",
SparkUI = new SparkUIProps {
Enabled = true
},
Executable = JobExecutable.PythonEtl(new PythonSparkJobExecutableProps {
GlueVersion = GlueVersion.V3_0,
PythonVersion = PythonVersion.THREE,
Script = Code.FromAsset(Join(__dirname, "job-script", "hello_world.py"))
})
});
Synopsis
Constructors
GlueVersion(ByRefValue) | Used by jsii to construct an instance of this class from a Javascript-owned object reference |
GlueVersion(DeputyBase.DeputyProps) | Used by jsii to construct an instance of this class from DeputyProps |
Properties
Name | (experimental) The name of this GlueVersion, as expected by Job resource. |
V0_9 | (experimental) Glue version using Spark 2.2.1 and Python 2.7. |
V1_0 | (experimental) Glue version using Spark 2.4.3, Python 2.7 and Python 3.6. |
V2_0 | (experimental) Glue version using Spark 2.4.3 and Python 3.7. |
V3_0 | (experimental) Glue version using Spark 3.1.1 and Python 3.7. |
V4_0 | (experimental) Glue version using Spark 3.3.0 and Python 3.10. |
Methods
Of(String) | (experimental) Custom Glue version. |
Constructors
GlueVersion(ByRefValue)
Used by jsii to construct an instance of this class from a Javascript-owned object reference
protected GlueVersion(ByRefValue reference)
Parameters
- reference Amazon.JSII.Runtime.Deputy.ByRefValue
The Javascript-owned object reference
GlueVersion(DeputyBase.DeputyProps)
Used by jsii to construct an instance of this class from DeputyProps
protected GlueVersion(DeputyBase.DeputyProps props)
Parameters
- props Amazon.JSII.Runtime.Deputy.DeputyBase.DeputyProps
The deputy props
Properties
Name
(experimental) The name of this GlueVersion, as expected by Job resource.
public virtual string Name { get; }
Property Value
System.String
Remarks
Stability: Experimental
V0_9
(experimental) Glue version using Spark 2.2.1 and Python 2.7.
public static GlueVersion V0_9 { get; }
Property Value
Remarks
Stability: Experimental
V1_0
(experimental) Glue version using Spark 2.4.3, Python 2.7 and Python 3.6.
public static GlueVersion V1_0 { get; }
Property Value
Remarks
Stability: Experimental
V2_0
(experimental) Glue version using Spark 2.4.3 and Python 3.7.
public static GlueVersion V2_0 { get; }
Property Value
Remarks
Stability: Experimental
V3_0
(experimental) Glue version using Spark 3.1.1 and Python 3.7.
public static GlueVersion V3_0 { get; }
Property Value
Remarks
Stability: Experimental
V4_0
(experimental) Glue version using Spark 3.3.0 and Python 3.10.
public static GlueVersion V4_0 { get; }
Property Value
Remarks
Stability: Experimental
Methods
Of(String)
(experimental) Custom Glue version.
public static GlueVersion Of(string version)
Parameters
- version System.String
custom version.
Returns
Remarks
Stability: Experimental