Class: Aws::Bedrock::Types::EvaluationDatasetMetricConfig

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-bedrock/lib/aws-sdk-bedrock/types.rb

Overview

Defines the built-in prompt datasets, built-in metric names and custom metric names, and the task type.

See Also:

Constant Summary collapse

SENSITIVE = 
[]

Instance Attribute Summary collapse

Instance Attribute Details

#dataset ⇒ Types::EvaluationDataset

Specifies the prompt dataset.

Returns:



771
772
773
774
775
776
777
 
# File 'gems/aws-sdk-bedrock/lib/aws-sdk-bedrock/types.rb', line 771

class EvaluationDatasetMetricConfig < Struct.new(
  :task_type,
  :dataset,
  :metric_names)
  SENSITIVE = []
  include Aws::Structure
end

#metric_names ⇒ Array<String>

The names of the metrics used. For automated model evaluation jobs valid values are "Builtin.Accuracy", "Builtin.Robustness", and "Builtin.Toxicity". In human-based model evaluation jobs the array of strings must match the name parameter specified in HumanEvaluationCustomMetric.

Returns:

  • (Array<String>) 


771
772
773
774
775
776
777
 
# File 'gems/aws-sdk-bedrock/lib/aws-sdk-bedrock/types.rb', line 771

class EvaluationDatasetMetricConfig < Struct.new(
  :task_type,
  :dataset,
  :metric_names)
  SENSITIVE = []
  include Aws::Structure
end

#task_type ⇒ String

The task type you want the model to carry out.

Returns:

  • (String) 


771
772
773
774
775
776
777
 
# File 'gems/aws-sdk-bedrock/lib/aws-sdk-bedrock/types.rb', line 771

class EvaluationDatasetMetricConfig < Struct.new(
  :task_type,
  :dataset,
  :metric_names)
  SENSITIVE = []
  include Aws::Structure
end