AWS Deep Learning Containers for PyTorch Inference ARM64 2.6 on EC2, ECS, EKS¶
AWS Deep Learning Containers for EC2, ECS, EKS are now available with PyTorch 2.6.
Announcements¶
-
Introduced containers for PyTorch 2.6.0 for Inference on EC2, ECS, EKS (ARM64)
-
Added Python 3.12 support
-
Starting with PyTorch 2.6, we are removing Conda from the DLCs and installing all Python packages from PyPI
Core Packages¶
| Package | Version |
|---|---|
| Python | 3.12.8 |
| PyTorch | 2.6.0 |
| TorchVision | 0.21.0 |
| TorchAudio | 2.6.0 |
| TorchText | 0.18.0 |
| TorchData | 0.10.1 |
| TorchServe | 0.12.0 |
| CUDA | 12.4.1 |
| cuDNN | 9.1.0.70 |
| NCCL | 2.21.5 |
| OpenMPI | 4.1.7 |
Security Advisory¶
AWS recommends that customers monitor critical security updates in the AWS Security Bulletin.
Reference¶
Docker Image URIs¶
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-arm64:2.6.0-gpu-py312-cu124-ubuntu22.04-ec2
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-arm64:2.6-gpu-py312-cu124-ubuntu22.04-ec2-v1
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-arm64:2.6.0-gpu-py312-ec2
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-arm64:2.6-gpu-py312-ec2
public.ecr.aws/deep-learning-containers/pytorch-inference-arm64:2.6.0-gpu-py312-cu124-ubuntu22.04-ec2
public.ecr.aws/deep-learning-containers/pytorch-inference-arm64:2.6-gpu-py312-cu124-ubuntu22.04-ec2-v1
public.ecr.aws/deep-learning-containers/pytorch-inference-arm64:2.6.0-gpu-py312-ec2
public.ecr.aws/deep-learning-containers/pytorch-inference-arm64:2.6-gpu-py312-ec2