Class SparkUIProps
(experimental) Properties for enabling Spark UI monitoring feature for Spark-based Glue jobs.
Inheritance
Implements
Namespace: Amazon.CDK.AWS.Glue
Assembly: Amazon.CDK.AWS.Glue.dll
Syntax (csharp)
public class SparkUIProps : Object, ISparkUIProps
Syntax (vb)
Public Class SparkUIProps
Inherits Object
Implements ISparkUIProps
Remarks
Stability: Experimental
See: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExampleMetadata: fixture=_generated
Examples
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Glue;
using Amazon.CDK.AWS.S3;
Bucket bucket;
var sparkUIProps = new SparkUIProps {
Enabled = false,
// the properties below are optional
Bucket = bucket,
Prefix = "prefix"
};
Synopsis
Constructors
SparkUIProps() |
Properties
Bucket | (experimental) The bucket where the Glue job stores the logs. |
Enabled | (experimental) Enable Spark UI. |
Prefix | (experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs. |
Constructors
SparkUIProps()
public SparkUIProps()
Properties
Bucket
(experimental) The bucket where the Glue job stores the logs.
public IBucket Bucket { get; set; }
Property Value
Remarks
Default: a new bucket will be created.
Stability: Experimental
Enabled
(experimental) Enable Spark UI.
public bool Enabled { get; set; }
Property Value
System.Boolean
Remarks
Stability: Experimental
Prefix
(experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs.
public string Prefix { get; set; }
Property Value
System.String
Remarks
Default: '/' - the logs will be written at the root of the bucket
Stability: Experimental