Solutions
With Solutions, you can get pre-built observability for third-party Kubernetes tools that run on your Amazon EKS clusters. Each solution collects metrics from a specific tool and surfaces them in a dedicated dashboard within Container Insights.
When you enable OTel Container Insights, every solution is on by default. If your cluster
doesn't run a tool, its solution finds no targets and sends nothing. To turn off one
solution, set its enabled value to false. To turn off all
OTel Container Insights solutions at once, set otelContainerInsights.solutions.enabled to
false. The following list gives the configuration value of each solution.
- Karpenter
-
otelContainerInsights.solutions.karpenter.enabled - KEDA
-
otelContainerInsights.solutions.keda.enabled - vLLM
-
otelContainerInsights.solutions.vllm.enabled - SGLang (version 8.0.0 and later)
-
otelContainerInsights.solutions.sglang.enabled - Ray (version 8.0.0 and later)
-
otelContainerInsights.solutions.ray.enabled - KServe control plane
-
otelContainerInsights.solutions.kserve.controlPlane.enabled - Knative Serving
-
otelContainerInsights.solutions.knative.dataPlane.enabledandotelContainerInsights.solutions.knative.controlPlane.enabled
The vLLM and SGLang solutions collect the inference
engine metrics, such as vllm:num_requests_running and
sglang:num_running_reqs, that uses to identify inference workloads. For
more information, see Accelerated Compute Insights.