Class JobExecutableConfig
(experimental) Result of binding a JobExecutable
into a Job
.
Inheritance
Implements
Namespace: Amazon.CDK.AWS.Glue
Assembly: Amazon.CDK.AWS.Glue.dll
Syntax (csharp)
public class JobExecutableConfig : Object, IJobExecutableConfig
Syntax (vb)
Public Class JobExecutableConfig
Inherits Object
Implements IJobExecutableConfig
Remarks
Stability: Experimental
ExampleMetadata: fixture=_generated
Examples
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Glue;
Code code;
GlueVersion glueVersion;
JobType jobType;
var jobExecutableConfig = new JobExecutableConfig {
GlueVersion = glueVersion,
Language = JobLanguage.SCALA,
Script = code,
Type = jobType,
// the properties below are optional
ClassName = "className",
ExtraFiles = new [] { code },
ExtraJars = new [] { code },
ExtraJarsFirst = false,
ExtraPythonFiles = new [] { code },
PythonVersion = PythonVersion.TWO
};
Synopsis
Constructors
JobExecutableConfig() |
Properties
ClassName | (experimental) The Scala class that serves as the entry point for the job. |
ExtraFiles | (experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. |
ExtraJars | (experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. |
ExtraJarsFirst | (experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath. |
ExtraPythonFiles | (experimental) Additional Python files that AWS Glue adds to the Python path before executing your script. |
GlueVersion | (experimental) Glue version. |
Language | (experimental) The language of the job (Scala or Python). |
PythonVersion | (experimental) The Python version to use. |
Script | (experimental) The script that is executed by a job. |
Type | (experimental) Specify the type of the job whether it's an Apache Spark ETL or streaming one or if it's a Python shell job. |
Constructors
JobExecutableConfig()
public JobExecutableConfig()
Properties
ClassName
(experimental) The Scala class that serves as the entry point for the job.
public string ClassName { get; set; }
Property Value
System.String
Remarks
This applies only if your the job langauage is Scala.
Default: - no scala className specified
Stability: Experimental
See: --class
in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExtraFiles
(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
public Code[] ExtraFiles { get; set; }
Property Value
Code[]
Remarks
Default: - no extra files specified.
Stability: Experimental
See: --extra-files
in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExtraJars
(experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script.
public Code[] ExtraJars { get; set; }
Property Value
Code[]
Remarks
Default: - no extra jars specified.
Stability: Experimental
See: --extra-jars
in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExtraJarsFirst
(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.
public Nullable<bool> ExtraJarsFirst { get; set; }
Property Value
System.Nullable<System.Boolean>
Remarks
Default: - extra jars are not prioritized.
Stability: Experimental
See: --user-jars-first
in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExtraPythonFiles
(experimental) Additional Python files that AWS Glue adds to the Python path before executing your script.
public Code[] ExtraPythonFiles { get; set; }
Property Value
Code[]
Remarks
Default: - no extra python files specified.
Stability: Experimental
See: --extra-py-files
in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
GlueVersion
(experimental) Glue version.
public GlueVersion GlueVersion { get; set; }
Property Value
Remarks
Stability: Experimental
See: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html
Language
(experimental) The language of the job (Scala or Python).
public JobLanguage Language { get; set; }
Property Value
Remarks
Stability: Experimental
See: --job-language
in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
PythonVersion
(experimental) The Python version to use.
public Nullable<PythonVersion> PythonVersion { get; set; }
Property Value
System.Nullable<PythonVersion>
Remarks
Default: - no python version specified
Stability: Experimental
Script
(experimental) The script that is executed by a job.
public Code Script { get; set; }
Property Value
Remarks
Stability: Experimental
Type
(experimental) Specify the type of the job whether it's an Apache Spark ETL or streaming one or if it's a Python shell job.
public JobType Type { get; set; }
Property Value
Remarks
Stability: Experimental