SampleOperationResult
The result of a completed sampling operation. Exactly one member is populated, corresponding to the operation type that was submitted.
Contents
Important
This data type is a UNION, so only one of the following members can be specified when used or returned.
- computeLogprobs
-
The computed log-probabilities for the prompt tokens.
Type: ComputeLogprobsResult object
Required: No
- loadWeightsForSampling
-
The result from loading weights for sampling.
Type: LoadWeightsForSamplingResult object
Required: No
- sample
-
The generated text samples from the model.
Type: SampleResponse object
Required: No
See Also
For more information about using this API in one of the language-specific Amazon SDKs, see the following: