vLLM (Ubuntu) Release Notes¶
Release notes for AWS Deep Learning Containers with vLLM (Ubuntu).
vLLM (Ubuntu) 0.20¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.20.2 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.20.2 | GPU | EC2, ECS, EKS | Release Notes |
| vLLM (Ubuntu) | 0.20.1 | GPU | EC2, ECS, EKS | Release Notes |
| vLLM (Ubuntu) | 0.20.1 | GPU | EC2, ECS, EKS | Release Notes |
| vLLM (Ubuntu) | 0.20.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.20.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.19¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.19.1 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.19.1 | GPU | EC2, ECS, EKS | Release Notes |
| vLLM (Ubuntu) | 0.19.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.19.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.18¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.18.1 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.18.1 | GPU | EC2, ECS, EKS | Release Notes |
| vLLM (Ubuntu) | 0.18.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.18.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.17¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.17.1 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.17.1 | GPU | EC2, ECS, EKS | Release Notes |
| vLLM (Ubuntu) | 0.17.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.17.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.16¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.16.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.16.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.15¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.15.1 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.15.1 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.14¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.14.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.14.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.13¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM (Ubuntu) | 0.13.0 | GPU | SageMaker | Release Notes |
| vLLM (Ubuntu) | 0.13.0 | GPU | EC2, ECS, EKS | Release Notes |
vLLM (Ubuntu) 0.10¶
| Framework | Version | Accelerator | Platform | Link |
|---|---|---|---|---|
| vLLM ARM64 | 0.10.2 | GPU | EC2, ECS, EKS | Release Notes |