SampleOperationConfig
The configuration for a sampling operation. Exactly one member must be set to specify the operation type.
Contents
Important
This data type is a UNION, so only one of the following members can be specified when used or returned.
- computeLogprobs
-
The configuration for computing log-probabilities of prompt tokens without generating new text.
Type: ComputeLogprobsConfig object
Required: No
- loadWeightsForSampling
-
The configuration for loading model weights for inference and sampling without restoring optimizer state.
Type: LoadWeightsForSamplingConfig object
Required: No
- sample
-
The configuration for generating text samples from the model.
Type: SampleConfig object
Required: No
See Also
For more information about using this API in one of the language-specific Amazon SDKs, see the following: