EvaluatorConfig
The configuration that defines how an evaluator assesses agent performance, including the evaluation method and parameters.
Contents
Important
This data type is a UNION, so only one of the following members can be specified when used or returned.
- codeBased
-
Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
Type: CodeBasedEvaluatorConfig object
Note: This object is a Union. Only one member of this object can be specified or returned.
Required: No
- derived
-
The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
Type: DerivedEvaluatorConfig object
Required: No
- llmAsAJudge
-
The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
Type: LlmAsAJudgeEvaluatorConfig object
Required: No
See Also
For more information about using this API in one of the language-specific Amazon SDKs, see the following: