AWS Deep Learning Containers for vLLM 0.17.0 on SageMaker¶
AWS Deep Learning Containers for SageMaker are now available with vLLM 0.17.0.
Announcements¶
- Introduced vLLM 0.17.0 containers for SageMaker
Core Packages¶
| Package | Version |
|---|---|
| vLLM | 0.17.0 |
| PyTorch | 2.10.0 |
| TorchVision | 0.25.0 |
| TorchAudio | 2.10.0 |
| CUDA | 12.9 |
| NCCL | 2.27.5 |
| EFA | 1.47.0 |
Security Advisory¶
AWS recommends that customers monitor critical security updates in the AWS Security Bulletin.
Reference¶
Docker Image URIs¶
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm:0.17.0-gpu-py312-cu129-ubuntu22.04-sagemaker
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm:0.17-gpu-py312-cu129-ubuntu22.04-sagemaker-v1
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm:0.17.0-gpu-py312
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm:0.17-gpu-py312
public.ecr.aws/deep-learning-containers/vllm:0.17.0-gpu-py312-cu129-ubuntu22.04-sagemaker
public.ecr.aws/deep-learning-containers/vllm:0.17-gpu-py312-cu129-ubuntu22.04-sagemaker-v1
public.ecr.aws/deep-learning-containers/vllm:0.17.0-gpu-py312
public.ecr.aws/deep-learning-containers/vllm:0.17-gpu-py312