vLLM Deep Learning Containers
Below are the release notes for vLLM Deep Learning Containers:
| Version | Type | Service | Architecture | Release Note |
|---|---|---|---|---|
| Latest | General | SageMaker | X86 | |
| Latest | General | EC2 | X86 | Amazon Deep Learning Containers for vLLM on EC2, ECS, and EKS |
| Latest | General | EC2 | ARM64 | Amazon Deep Learning Containers for vLLM ARM64 on EC2, ECS, and EKS |