View a markdown version of this page

SampleTokenUsage - Amazon SageMaker
ContentsSee Also
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

SampleTokenUsage

The token usage statistics for a sample generation.

Contents

decode

The number of tokens generated (decode phase).

Type: Integer

Required: Yes

prefill

The number of tokens in the input prompt (prefill phase).

Type: Integer

Required: Yes

See Also

For more information about using this API in one of the language-specific Amazon SDKs, see the following: