class JobExecutable
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Glue.Alpha.JobExecutable |
Go | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#JobExecutable |
Java | software.amazon.awscdk.services.glue.alpha.JobExecutable |
Python | aws_cdk.aws_glue_alpha.JobExecutable |
TypeScript (source) | @aws-cdk/aws-glue-alpha ยป JobExecutable |
The executable properties related to the Glue job's GlueVersion, JobType and code.
Example
new glue.Job(this, 'EnableSparkUI', {
jobName: 'EtlJobWithSparkUIPrefix',
sparkUI: {
enabled: true,
},
executable: glue.JobExecutable.pythonEtl({
glueVersion: glue.GlueVersion.V3_0,
pythonVersion: glue.PythonVersion.THREE,
script: glue.Code.fromAsset(path.join(__dirname, 'job-script', 'hello_world.py')),
}),
});
Methods
Name | Description |
---|---|
bind() | Called during Job initialization to get JobExecutableConfig. |
static of(config) | Create a custom JobExecutable. |
static python | Create Python executable props for Apache Spark ETL job. |
static python | Create Python executable props for Ray jobs. |
static python | Create Python executable props for python shell jobs. |
static python | Create Python executable props for Apache Spark Streaming job. |
static scala | Create Scala executable props for Apache Spark ETL job. |
static scala | Create Scala executable props for Apache Spark Streaming job. |
bind()
public bind(): JobExecutableConfig
Returns
Called during Job initialization to get JobExecutableConfig.
static of(config)
public static of(config: JobExecutableConfig): JobExecutable
Parameters
- config
Job
โ custom job executable configuration.Executable Config
Returns
Create a custom JobExecutable.
Etl(props)
static pythonpublic static pythonEtl(props: PythonSparkJobExecutableProps): JobExecutable
Parameters
- props
Python
โ Python Apache Spark Job props.Spark Job Executable Props
Returns
Create Python executable props for Apache Spark ETL job.
Ray(props)
static pythonpublic static pythonRay(props: PythonRayExecutableProps): JobExecutable
Parameters
- props
Python
โ Ray Job props.Ray Executable Props
Returns
Create Python executable props for Ray jobs.
Shell(props)
static pythonpublic static pythonShell(props: PythonShellExecutableProps): JobExecutable
Parameters
- props
Python
โ Python Shell Job props.Shell Executable Props
Returns
Create Python executable props for python shell jobs.
Streaming(props)
static pythonpublic static pythonStreaming(props: PythonSparkJobExecutableProps): JobExecutable
Parameters
- props
Python
โ Python Apache Spark Job props.Spark Job Executable Props
Returns
Create Python executable props for Apache Spark Streaming job.
Etl(props)
static scalapublic static scalaEtl(props: ScalaJobExecutableProps): JobExecutable
Parameters
- props
Scala
โ Scala Apache Spark Job props.Job Executable Props
Returns
Create Scala executable props for Apache Spark ETL job.
Streaming(props)
static scalapublic static scalaStreaming(props: ScalaJobExecutableProps): JobExecutable
Parameters
- props
Scala
โ Scala Apache Spark Job props.Job Executable Props
Returns
Create Scala executable props for Apache Spark Streaming job.