Skip to content

vLLM (Ubuntu) Release Notes

Release notes for AWS Deep Learning Containers with vLLM (Ubuntu).

vLLM (Ubuntu) 0.20

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.20.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.20.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.19

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.19.1 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.19.1 GPU EC2, ECS, EKS Release Notes
vLLM (Ubuntu) 0.19.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.19.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.18

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.18.1 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.18.1 GPU EC2, ECS, EKS Release Notes
vLLM (Ubuntu) 0.18.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.18.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.17

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.17.1 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.17.1 GPU EC2, ECS, EKS Release Notes
vLLM (Ubuntu) 0.17.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.17.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.16

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.16.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.16.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.15

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.15.1 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.15.1 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.14

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.14.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.14.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.13

Framework Version Accelerator Platform Link
vLLM (Ubuntu) 0.13.0 GPU SageMaker Release Notes
vLLM (Ubuntu) 0.13.0 GPU EC2, ECS, EKS Release Notes

vLLM (Ubuntu) 0.10

Framework Version Accelerator Platform Link
vLLM ARM64 0.10.2 GPU EC2, ECS, EKS Release Notes