AWS services or capabilities described in AWS Documentation may vary by region/location. Click Getting Started with Amazon AWS to see specific differences applicable to the China (Beijing) Region.

You are viewing documentation for version 2 of the AWS SDK for Ruby. Version 3 documentation can be found here.

Class: Aws::SageMaker::Types::ProcessingS3Input

Inherits:
Struct
  • Object
show all
Defined in:
(unknown)

Overview

Note:

When passing ProcessingS3Input as input to an Aws::Client method, you can use a vanilla Hash:

{
  s3_uri: "S3Uri", # required
  local_path: "ProcessingLocalPath", # required
  s3_data_type: "ManifestFile", # required, accepts ManifestFile, S3Prefix
  s3_input_mode: "Pipe", # required, accepts Pipe, File
  s3_data_distribution_type: "FullyReplicated", # accepts FullyReplicated, ShardedByS3Key
  s3_compression_type: "None", # accepts None, Gzip
}

Information about where and how you want to obtain the inputs for an processing job.

Returned by:

Instance Attribute Summary collapse

Instance Attribute Details

#local_pathString

The local path to the Amazon S3 bucket where you want Amazon SageMaker to download the inputs to run a processing job. LocalPath is an absolute path to the input data.

Returns:

  • (String)

    The local path to the Amazon S3 bucket where you want Amazon SageMaker to download the inputs to run a processing job.

#s3_compression_typeString

Whether to use Gzip compression for Amazon S3 storage.

Possible values:

  • None
  • Gzip

Returns:

  • (String)

    Whether to use Gzip compression for Amazon S3 storage.

#s3_data_distribution_typeString

Whether the data stored in Amazon S3 is FullyReplicated or ShardedByS3Key.

Possible values:

  • FullyReplicated
  • ShardedByS3Key

Returns:

  • (String)

    Whether the data stored in Amazon S3 is FullyReplicated or ShardedByS3Key.

#s3_data_typeString

Whether you use an S3Prefix or a ManifestFile for the data type. If you choose S3Prefix, S3Uri identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose ManifestFile, S3Uri identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.

Possible values:

  • ManifestFile
  • S3Prefix

Returns:

  • (String)

    Whether you use an S3Prefix or a ManifestFile for the data type.

#s3_input_modeString

Whether to use File or Pipe input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.

Possible values:

  • Pipe
  • File

Returns:

  • (String)

    Whether to use File or Pipe input mode.

#s3_uriString

The URI for the Amazon S3 storage where you want Amazon SageMaker to download the artifacts needed to run a processing job.

Returns:

  • (String)

    The URI for the Amazon S3 storage where you want Amazon SageMaker to download the artifacts needed to run a processing job.