Interface ModelInvocationInput.Builder
- All Superinterfaces:
Buildable
,CopyableBuilder<ModelInvocationInput.Builder,
,ModelInvocationInput> SdkBuilder<ModelInvocationInput.Builder,
,ModelInvocationInput> SdkPojo
- Enclosing class:
ModelInvocationInput
-
Method Summary
Modifier and TypeMethodDescriptiondefault ModelInvocationInput.Builder
inferenceConfiguration
(Consumer<InferenceConfiguration.Builder> inferenceConfiguration) Specifications about the inference parameters that were provided alongside the prompt.inferenceConfiguration
(InferenceConfiguration inferenceConfiguration) Specifications about the inference parameters that were provided alongside the prompt.overrideLambda
(String overrideLambda) The ARN of the Lambda function to use when parsing the raw foundation model output in parts of the agent sequence.parserMode
(String parserMode) Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by thepromptType
.parserMode
(CreationMode parserMode) Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by thepromptType
.promptCreationMode
(String promptCreationMode) Specifies whether the default prompt template wasOVERRIDDEN
.promptCreationMode
(CreationMode promptCreationMode) Specifies whether the default prompt template wasOVERRIDDEN
.The text that prompted the agent at this step.The unique identifier of the trace.The step in the agent sequence.type
(PromptType type) The step in the agent sequence.Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copy
Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, build
Methods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFields
-
Method Details
-
inferenceConfiguration
Specifications about the inference parameters that were provided alongside the prompt. These are specified in the PromptOverrideConfiguration object that was set when the agent was created or updated. For more information, see Inference parameters for foundation models.
- Parameters:
inferenceConfiguration
- Specifications about the inference parameters that were provided alongside the prompt. These are specified in the PromptOverrideConfiguration object that was set when the agent was created or updated. For more information, see Inference parameters for foundation models.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
inferenceConfiguration
default ModelInvocationInput.Builder inferenceConfiguration(Consumer<InferenceConfiguration.Builder> inferenceConfiguration) Specifications about the inference parameters that were provided alongside the prompt. These are specified in the PromptOverrideConfiguration object that was set when the agent was created or updated. For more information, see Inference parameters for foundation models.
This is a convenience method that creates an instance of theInferenceConfiguration.Builder
avoiding the need to create one manually viaInferenceConfiguration.builder()
.When the
Consumer
completes,SdkBuilder.build()
is called immediately and its result is passed toinferenceConfiguration(InferenceConfiguration)
.- Parameters:
inferenceConfiguration
- a consumer that will call methods onInferenceConfiguration.Builder
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
overrideLambda
The ARN of the Lambda function to use when parsing the raw foundation model output in parts of the agent sequence.
- Parameters:
overrideLambda
- The ARN of the Lambda function to use when parsing the raw foundation model output in parts of the agent sequence.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
parserMode
Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the
promptType
.- Parameters:
parserMode
- Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by thepromptType
.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
parserMode
Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the
promptType
.- Parameters:
parserMode
- Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by thepromptType
.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
promptCreationMode
Specifies whether the default prompt template was
OVERRIDDEN
. If it was, thebasePromptTemplate
that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.- Parameters:
promptCreationMode
- Specifies whether the default prompt template wasOVERRIDDEN
. If it was, thebasePromptTemplate
that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
promptCreationMode
Specifies whether the default prompt template was
OVERRIDDEN
. If it was, thebasePromptTemplate
that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.- Parameters:
promptCreationMode
- Specifies whether the default prompt template wasOVERRIDDEN
. If it was, thebasePromptTemplate
that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
text
The text that prompted the agent at this step.
- Parameters:
text
- The text that prompted the agent at this step.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
traceId
The unique identifier of the trace.
- Parameters:
traceId
- The unique identifier of the trace.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
type
The step in the agent sequence.
- Parameters:
type
- The step in the agent sequence.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
type
The step in the agent sequence.
- Parameters:
type
- The step in the agent sequence.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-