AWS Deep Learning Containers for vLLM ARM64 0.10.2 on EC2, ECS, EKS¶
AWS Deep Learning Containers for EC2, ECS, EKS are now available with vLLM 0.10.2.
Announcements¶
-
Introduced vLLM ARM64 0.10.2 containers for EC2, ECS, EKS
-
Added Python 3.12 support
Core Packages¶
| Package | Version |
|---|---|
| vLLM | 0.10.2 |
| PyTorch | 2.8.0 |
| TorchVision | 0.23.0 |
| TorchAudio | 2.8.0 |
| CUDA | 12.9.1 |
| cuDNN | 9.10.2.21 |
| NCCL | 2.27.3-1 |
| EFA | 1.43.2 |
Security Advisory¶
AWS recommends that customers monitor critical security updates in the AWS Security Bulletin.
Reference¶
Docker Image URIs¶
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm-arm64:0.10.2-gpu-py312-cu129-ubuntu22.04-ec2
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm-arm64:0.10-gpu-py312-cu129-ubuntu22.04-ec2-v1
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm-arm64:0.10.2-gpu-py312-ec2
763104351884.dkr.ecr.us-west-2.amazonaws.com/vllm-arm64:0.10-gpu-py312-ec2
public.ecr.aws/deep-learning-containers/vllm-arm64:0.10.2-gpu-py312-cu129-ubuntu22.04-ec2
public.ecr.aws/deep-learning-containers/vllm-arm64:0.10-gpu-py312-cu129-ubuntu22.04-ec2-v1
public.ecr.aws/deep-learning-containers/vllm-arm64:0.10.2-gpu-py312-ec2
public.ecr.aws/deep-learning-containers/vllm-arm64:0.10-gpu-py312-ec2