HarnessLiteLlmModelConfig
Configuration for a LiteLLM model provider, enabling connection to third-party model providers.
Contents
- modelId
-
The LiteLLM model identifier (e.g., "anthropic/claude-3-sonnet").
Type: String
Required: Yes
- additionalParams
-
Provider-specific parameters passed through to the model provider unchanged.
Type: JSON value
Required: No
- apiBase
-
The base URL for the model provider's API endpoint.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 16383.
Required: No
- apiKeyArn
-
The ARN of the API key in AgentCore Identity for authenticating with the model provider.
Type: String
Pattern:
arn:aws:bedrock-agentcore:[a-z0-9-]+:[0-9]{12}:token-vault/[a-zA-Z0-9-.]+/apikeycredentialprovider/[a-zA-Z0-9-.]+Required: No
- maxTokens
-
The maximum number of tokens to allow in the generated response per iteration.
Type: Integer
Valid Range: Minimum value of 1.
Required: No
- temperature
-
The temperature to set when calling the model.
Type: Float
Valid Range: Minimum value of 0.0. Maximum value of 2.0.
Required: No
- topP
-
The topP set when calling the model.
Type: Float
Valid Range: Minimum value of 0.0. Maximum value of 1.0.
Required: No
See Also
For more information about using this API in one of the language-specific Amazon SDKs, see the following: