AWS::BedrockAgentCore::Evaluator InferenceConfiguration - Amazon CloudFormation
SyntaxProperties
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

This is the new Amazon CloudFormation Template Reference Guide. Please update your bookmarks and links. For help getting started with CloudFormation, see the Amazon CloudFormation User Guide.

AWS::BedrockAgentCore::Evaluator InferenceConfiguration

The inference configuration parameters that control model behavior during evaluation, including temperature, token limits, and sampling settings.

Syntax

To declare this entity in your Amazon CloudFormation template, use the following syntax:

JSON

{
  "MaxTokens" : Integer,
  "Temperature" : Number,
  "TopP" : Number
}

YAML

  MaxTokens: Integer
  Temperature: Number
  TopP: Number

Properties

MaxTokens

The maximum number of tokens to generate in the model response during evaluation.

Required: No

Type: Integer

Minimum: 1

Update requires: No interruption

Temperature

The temperature value that controls randomness in the model's responses. Lower values produce more deterministic outputs.

Required: No

Type: Number

Minimum: 0

Maximum: 1

Update requires: No interruption

TopP

The top-p sampling parameter that controls the diversity of the model's responses by limiting the cumulative probability of token choices.

Required: No

Type: Number

Minimum: 0

Maximum: 1

Update requires: No interruption