Package software.amazon.awscdk.services.glue.alpha

Class WorkerType

java.lang.Object

software.amazon.jsii.JsiiObject

software.amazon.awscdk.services.glue.alpha.WorkerType

All Implemented Interfaces:

software.amazon.jsii.JsiiSerializable

@Generated(value="jsii-pacmak/1.98.0 (build 00b106d)",
           date="2024-05-08T21:35:15.800Z")
@Stability(Experimental)
public class WorkerType
extends software.amazon.jsii.JsiiObject

(experimental) The type of predefined worker that is allocated when a job runs.

If you need to use a WorkerType that doesn't exist as a static member, you can instantiate a WorkerType object, e.g: WorkerType.of('other type').

Example:

 Bucket bucket;
 Job.Builder.create(this, "ScalaSparkEtlJob")
         .executable(JobExecutable.scalaEtl(ScalaJobExecutableProps.builder()
                 .glueVersion(GlueVersion.V4_0)
                 .script(Code.fromBucket(bucket, "src/com/example/HelloWorld.scala"))
                 .className("com.example.HelloWorld")
                 .extraJars(List.of(Code.fromBucket(bucket, "jars/HelloWorld.jar")))
                 .build()))
         .workerType(WorkerType.G_8X)
         .description("an example Scala ETL job")
         .build();
 

Nested Class Summary

Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject

software.amazon.jsii.JsiiObject.InitializationMode

Field Summary

Fields

Modifier and Type	Field	Description
static final WorkerType	G_025_X	(experimental) Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker.
static final WorkerType	G_1_X	(experimental) Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.
static final WorkerType	G_2_X	(experimental) Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.
static final WorkerType	G_4_X	(experimental) Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.
static final WorkerType	G_8_X	(experimental) Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.
static final WorkerType	STANDARD	(experimental) Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
static final WorkerType	Z_2_X	(experimental) Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	WorkerType(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)
protected	WorkerType(software.amazon.jsii.JsiiObjectRef objRef)

Method Summary

Modifier and Type	Method	Description
String	getName()	(experimental) The name of this WorkerType, as expected by Job resource.
static WorkerType	of(String workerType)	(experimental) Custom worker type.

Methods inherited from class software.amazon.jsii.JsiiObject

jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSet

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Field Details

G_025_X

@Stability(Experimental)
public static final WorkerType G_025_X

(experimental) Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs.

G_1_X

@Stability(Experimental)
public static final WorkerType G_1_X

(experimental) Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.

Suitable for memory-intensive jobs.

G_2_X

@Stability(Experimental)
public static final WorkerType G_2_X

(experimental) Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.

Suitable for memory-intensive jobs.

G_4_X

@Stability(Experimental)
public static final WorkerType G_4_X

(experimental) Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.

We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.

G_8_X

@Stability(Experimental)
public static final WorkerType G_8_X

(experimental) Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.

We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.

STANDARD

@Stability(Experimental)
public static final WorkerType STANDARD

(experimental) Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

Z_2_X

@Stability(Experimental)
public static final WorkerType Z_2_X

(experimental) Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).

Supported in Ray jobs.

Constructor Details

WorkerType

protected WorkerType(software.amazon.jsii.JsiiObjectRef objRef)

WorkerType

protected WorkerType(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)

Method Details

of

@Stability(Experimental)
@NotNull
public static WorkerType of(@NotNull
 String workerType)

(experimental) Custom worker type.

Parameters:

workerType - custom worker type. This parameter is required.

getName

@Stability(Experimental)
@NotNull
public String getName()

(experimental) The name of this WorkerType, as expected by Job resource.