Interface ModelInvocationInput.Builder

All Superinterfaces:
Buildable, CopyableBuilder<ModelInvocationInput.Builder,ModelInvocationInput>, SdkBuilder<ModelInvocationInput.Builder,ModelInvocationInput>, SdkPojo
Enclosing class:
ModelInvocationInput

public static interface ModelInvocationInput.Builder extends SdkPojo, CopyableBuilder<ModelInvocationInput.Builder,ModelInvocationInput>
  • Method Details

    • inferenceConfiguration

      ModelInvocationInput.Builder inferenceConfiguration(InferenceConfiguration inferenceConfiguration)

      Specifications about the inference parameters that were provided alongside the prompt. These are specified in the PromptOverrideConfiguration object that was set when the agent was created or updated. For more information, see Inference parameters for foundation models.

      Parameters:
      inferenceConfiguration - Specifications about the inference parameters that were provided alongside the prompt. These are specified in the PromptOverrideConfiguration object that was set when the agent was created or updated. For more information, see Inference parameters for foundation models.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inferenceConfiguration

      default ModelInvocationInput.Builder inferenceConfiguration(Consumer<InferenceConfiguration.Builder> inferenceConfiguration)

      Specifications about the inference parameters that were provided alongside the prompt. These are specified in the PromptOverrideConfiguration object that was set when the agent was created or updated. For more information, see Inference parameters for foundation models.

      This is a convenience method that creates an instance of the InferenceConfiguration.Builder avoiding the need to create one manually via InferenceConfiguration.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to inferenceConfiguration(InferenceConfiguration).

      Parameters:
      inferenceConfiguration - a consumer that will call methods on InferenceConfiguration.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • overrideLambda

      ModelInvocationInput.Builder overrideLambda(String overrideLambda)

      The ARN of the Lambda function to use when parsing the raw foundation model output in parts of the agent sequence.

      Parameters:
      overrideLambda - The ARN of the Lambda function to use when parsing the raw foundation model output in parts of the agent sequence.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • parserMode

      ModelInvocationInput.Builder parserMode(String parserMode)

      Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the promptType.

      Parameters:
      parserMode - Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the promptType.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • parserMode

      Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the promptType.

      Parameters:
      parserMode - Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the promptType.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • promptCreationMode

      ModelInvocationInput.Builder promptCreationMode(String promptCreationMode)

      Specifies whether the default prompt template was OVERRIDDEN. If it was, the basePromptTemplate that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.

      Parameters:
      promptCreationMode - Specifies whether the default prompt template was OVERRIDDEN. If it was, the basePromptTemplate that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • promptCreationMode

      ModelInvocationInput.Builder promptCreationMode(CreationMode promptCreationMode)

      Specifies whether the default prompt template was OVERRIDDEN. If it was, the basePromptTemplate that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.

      Parameters:
      promptCreationMode - Specifies whether the default prompt template was OVERRIDDEN. If it was, the basePromptTemplate that was set in the PromptOverrideConfiguration object when the agent was created or updated is used instead.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • text

      The text that prompted the agent at this step.

      Parameters:
      text - The text that prompted the agent at this step.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • traceId

      The unique identifier of the trace.

      Parameters:
      traceId - The unique identifier of the trace.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • type

      The step in the agent sequence.

      Parameters:
      type - The step in the agent sequence.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • type

      The step in the agent sequence.

      Parameters:
      type - The step in the agent sequence.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: