Available Images
This page is for referencing our supported Deep Learning Containers.
Refer to the tables below for all images that are available in Amazon ECR repositories. For private ECR access and region-specific account IDs, see Region Availability.
Base
These images are also available in ECR Public Gallery: base
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| Base 13.0.2 |
py313 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:13.0.2-gpu-py313-cu130-ubuntu22.04-ec2 |
| Base 13.0.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:13.0.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| Base 12.9.1 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.9.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| Base 12.9 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.9.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| Base 12.8.1 |
py312 |
cu128 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.8.1-gpu-py312-cu128-ubuntu24.04-ec2 |
| Base 12.8.0 |
py312 |
cu128 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.8.0-gpu-py312-cu128-ubuntu22.04-ec2 |
| Base 2 |
py313 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:devel-cuda-v2 |
| Base 1 |
py313 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:devel-cuda-v1 |
Ray
These images are also available in ECR Public Gallery: ray
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| Ray 2.55 |
py313 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cuda-v1 |
| Ray 2.55 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cpu-v1 |
| Ray 2.55 |
py313 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cuda-v1 |
| Ray 2.55 |
py313 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cpu-v1 |
| Ray 2.54 |
py313 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cuda-v1.0 |
| Ray 2.54 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cpu-v1.0 |
| Ray 2.54 |
py313 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cuda-v1.0 |
| Ray 2.54 |
py313 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cpu-v1.0 |
SGLang
These images are also available in ECR Public Gallery: sglang
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| SGLang 0.5.12 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.12-gpu-py312-cu130-ubuntu24.04-sagemaker |
| SGLang 0.5.12 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.12-gpu-py312-cu130-ubuntu24.04-ec2 |
| SGLang 0.5.11 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.11-gpu-py312-cu130-ubuntu24.04-sagemaker |
| SGLang 0.5.11 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.11-gpu-py312-cu130-ubuntu24.04-ec2 |
| SGLang 0.5.10 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.10-gpu-py312-cu129-ubuntu24.04-sagemaker |
| SGLang 0.5.10 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.10-gpu-py312-cu129-ubuntu24.04-ec2 |
| SGLang 0.5.9 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.9-gpu-py312-cu129-ubuntu24.04-sagemaker |
| SGLang 0.5.9 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.9-gpu-py312-cu129-ubuntu24.04-ec2 |
| SGLang 0.5.8 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.8-gpu-py312-cu129-ubuntu24.04-sagemaker |
| SGLang 0.5.7 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.7-gpu-py312-cu129-ubuntu24.04-sagemaker |
| SGLang 0.5.6 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.6-gpu-py312-cu129-ubuntu22.04-sagemaker |
| SGLang 0.5.5 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.5-gpu-py312-cu129-ubuntu22.04-sagemaker |
vLLM (Ubuntu)
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| vLLM 0.21.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.21.0-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.21.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.21.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| vLLM 0.20.2 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.20.2-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.20.2 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.20.2-gpu-py312-cu130-ubuntu22.04-ec2 |
| vLLM 0.20.1 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.20.1-gpu-py312-cu130-ubuntu22.04-ec2 |
| vLLM 0.20.1 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.20.1-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.20.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.20.0-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.20.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.20.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| vLLM 0.19.1 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.19.1-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.19.1 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.19.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.19.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.19.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.19.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.19.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.18.1 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.18.1-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.18.1 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.18.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.18.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.18.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.18.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.18.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.17.1 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.17.1-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.17.1 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.17.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.17.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.17.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.17.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.17.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.16.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.16.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.16.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.16.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.15.1 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.15.1-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.15.1 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.15.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.14.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.14.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.14.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.14.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.13.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.13.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.13.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.13.0-gpu-py312-cu129-ubuntu22.04-ec2 |
vLLM
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| vLLM 0.19.1+amzn2023.6ef1efd5 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-sagemaker-cuda-v1 |
| vLLM 0.19.1+amzn2023.6ef1efd5 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-cuda-v1 |
vLLM ARM64
These images are also available in ECR Public Gallery: vllm-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| vLLM 0.10.2 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm-arm64:0.10.2-gpu-py312-cu129-ubuntu22.04-ec2 |
vLLM-Omni
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.1 |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.1 |
| vLLM-Omni 0.18.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.0 |
| vLLM-Omni 0.18.0 |
py312 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.0 |
PyTorch Training
These images are also available in ECR Public Gallery: pytorch-training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 2.10 |
py313 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-gpu-py313-cu130-ubuntu22.04-sagemaker |
| PyTorch 2.10 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-cpu-py313-ubuntu22.04-sagemaker |
| PyTorch 2.10 |
py313 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-gpu-py313-cu130-ubuntu22.04-ec2 |
| PyTorch 2.10 |
py313 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-cpu-py313-ubuntu22.04-ec2 |
| PyTorch 2.9 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-gpu-py312-cu130-ubuntu22.04-sagemaker |
| PyTorch 2.9 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.9 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| PyTorch 2.9 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-cpu-py312-ubuntu22.04-ec2 |
| PyTorch 2.8 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| PyTorch 2.8 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.8 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| PyTorch 2.8 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-cpu-py312-ubuntu22.04-ec2 |
PyTorch Inference
These images are also available in ECR Public Gallery: pytorch-inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 2.6 |
py312 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference:2.6.0-gpu-py312-cu124-ubuntu22.04-sagemaker |
| PyTorch 2.6 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference:2.6.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.6 |
py312 |
cu124 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference:2.6.0-gpu-py312-cu124-ubuntu22.04-ec2 |
| PyTorch 2.6 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference:2.6.0-cpu-py312-ubuntu22.04-ec2 |
PyTorch Inference ARM64
These images are also available in ECR Public Gallery: pytorch-inference-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 2.6 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-arm64:2.6.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.6 |
py312 |
cu124 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-arm64:2.6.0-gpu-py312-cu124-ubuntu22.04-ec2 |
| PyTorch 2.6 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-arm64:2.6.0-cpu-py312-ubuntu22.04-ec2 |
PyTorch Training NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URL |
| PyTorch 2.9 |
py312 |
2.27.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.28.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.28.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.29.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.29.1-ubuntu24.04 |
| PyTorch 2.8 |
py311 |
2.26.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.25.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
| PyTorch 2.6 |
py310 |
2.23.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.6.0-neuronx-py310-sdk2.23.0-ubuntu22.04 |
PyTorch Inference NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URL |
| PyTorch 2.9 |
py312 |
2.27.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.28.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.28.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.29.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.29.1-ubuntu24.04 |
| PyTorch 2.8 |
py311 |
2.26.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.25.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
| PyTorch 2.6 |
py310 |
2.23.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.6.0-neuronx-py310-sdk2.23.0-ubuntu22.04 |
TensorFlow Inference NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.10 |
py310 |
2.17.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference-neuronx:2.10.1-neuronx-py310-sdk2.17.0-ubuntu20.04 |
HuggingFace PyTorch Training
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.9 |
py312 |
cu130 |
5.3.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.9.0-transformers5.3.0-gpu-py312-cu130-ubuntu22.04 |
| PyTorch 2.5 |
py311 |
cu124 |
4.49.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.5.1-transformers4.49.0-gpu-py311-cu124-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
cu121 |
4.36.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.1.0-transformers4.36.0-gpu-py310-cu121-ubuntu20.04 |
| PyTorch 2.0 |
py310 |
cu118 |
4.28.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.0.0-transformers4.28.1-gpu-py310-cu118-ubuntu20.04 |
| PyTorch 1.13 |
py39 |
cu117 |
4.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:1.13.1-transformers4.26.0-gpu-py39-cu117-ubuntu20.04 |
HuggingFace PyTorch Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.6 |
py312 |
cu124 |
5.5.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.6.0-transformers5.5.3-gpu-py312-cu124-ubuntu22.04 |
| PyTorch 2.6 |
py312 |
- |
5.5.3 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.6.0-transformers5.5.3-cpu-py312-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
cu118 |
4.37.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-gpu-py310-cu118-ubuntu20.04 |
| PyTorch 2.1 |
py310 |
- |
4.37.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-cpu-py310-ubuntu22.04 |
HuggingFace vLLM Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| vLLM 0.17.0 |
py312 |
cu129 |
4.57.5 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.17.0-transformers4.57.5-gpu-py312-cu129-ubuntu22.04 |
| vLLM 0.14.0 |
py312 |
cu129 |
4.57.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.14.0-transformers4.57.3-gpu-py312-cu129-ubuntu22.04 |
HuggingFace SGLang Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| SGLang 0.5.8 |
py312 |
cu129 |
4.57.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-sglang:0.5.8-transformers4.57.3-gpu-py312-cu129-ubuntu24.04 |
HuggingFace vLLM Inference NeuronX
| Framework |
Python |
SDK |
Optimum |
Accelerator |
Platform |
Example URL |
| vLLM 0.11 |
py310 |
2.26.1 |
0.4.5 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm-inference-neuronx:0.11.0-optimum0.4.5-neuronx-py310-sdk2.26.1-ubuntu22.04 |
HuggingFace PyTorch Training NeuronX
| Framework |
Python |
SDK |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.8 |
py310 |
2.26.0 |
4.55.4 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
4.51.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.7.0-transformers4.51.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
2.20.0 |
4.48.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.48.1-neuronx-py310-sdk2.20.0-ubuntu20.04 |
HuggingFace PyTorch Inference NeuronX
| Framework |
Python |
SDK |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.8 |
py310 |
2.26.0 |
4.55.4 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
4.51.3 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.7.1-transformers4.51.3-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
2.20.0 |
4.43.2 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.43.2-neuronx-py310-sdk2.20.0-ubuntu20.04 |
HuggingFace PyTorch Training Compiler
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 1.11 |
py38 |
cu113 |
4.21.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-trcomp-training:1.11.0-transformers4.21.1-gpu-py38-cu113-ubuntu20.04 |
HuggingFace TensorFlow Training
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.6 |
py38 |
cu112 |
4.17.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-training:2.6.3-transformers4.17.0-gpu-py38-cu112-ubuntu20.04 |
HuggingFace TensorFlow Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.11 |
py39 |
cu112 |
4.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-inference:2.11.1-transformers4.26.0-gpu-py39-cu112-ubuntu20.04 |
| TensorFlow 2.11 |
py39 |
- |
4.26.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-inference:2.11.1-transformers4.26.0-cpu-py39-ubuntu20.04 |
AutoGluon Training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| AutoGluon 1.5 |
py312 |
cu126 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.5.0-gpu-py312-cu126-ubuntu22.04 |
| AutoGluon 1.5 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.5.0-cpu-py312-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.4.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.4.0-cpu-py311-ubuntu22.04 |
AutoGluon Inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| AutoGluon 1.5 |
py312 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.5.0-gpu-py312-cu124-ubuntu22.04 |
| AutoGluon 1.5 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.5.0-cpu-py312-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.4.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.4.0-cpu-py311-ubuntu22.04 |
DJL Inference
| Framework |
CUDA |
Engine |
Accelerator |
Platform |
Example URL |
| DJLServing 0.36 |
cu130 |
LMI 25.0.0, vLLM 0.20.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi25.0.0-cu130 |
| DJLServing 0.36 |
cu129 |
LMI 24.0.0, vLLM 0.19.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi24.0.0-cu129 |
| DJLServing 0.36 |
cu129 |
LMI 23.0.0, vLLM 0.18.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi23.0.0-cu129 |
| DJLServing 0.36 |
cu129 |
LMI 22.0.0, vLLM 0.17.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi22.0.0-cu129 |
| DJLServing 0.36 |
cu129 |
LMI 21.0.0, vLLM 0.16.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi21.0.0-cu129 |
| DJLServing 0.36 |
cu128 |
LMI 20.0.0, vLLM 0.15.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi20.0.0-cu128 |
| DJLServing 0.36 |
cu128 |
LMI 19.0.0, vLLM 0.14.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi19.0.0-cu128 |
| DJLServing 0.36 |
cu128 |
LMI 18.0.0, vLLM 0.12.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi18.0.0-cu128 |
| DJLServing 0.36 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-cpu-full |
| DJLServing 0.35 |
cu128 |
LMI 17.0.0, vLLM 0.11.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.35.0-lmi17.0.0-cu128 |
| DJLServing 0.35 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.35.0-cpu-full |
| DJLServing 0.34 |
cu128 |
LMI 16.0.0, vLLM 0.10.2 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.34.0-lmi16.0.0-cu128 |
| DJLServing 0.33 |
cu128 |
LMI 15.0.0, vLLM 0.8.4 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.33.0-lmi15.0.0-cu128 |
| DJLServing 0.33 |
cu128 |
TensorRT-LLM 0.21.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.33.0-tensorrtllm0.21.0-cu128 |
| DJLServing 0.32 |
cu126 |
LMI 14.0.0, vLLM 0.6.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.32.0-lmi14.0.0-cu126 |
| DJLServing 0.32 |
cu125 |
TensorRT-LLM 0.12.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.32.0-tensorrtllm0.12.0-cu125 |
NVIDIA Triton Server for SageMaker
| Framework |
Python |
Accelerator |
Platform |
Example URL |
| Triton 26.03 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:26.03-py3 |
| Triton 25.09 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:25.09-py3 |
| Triton 25.04 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:25.04-py3 |
| Triton 24.09 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.09-py3 |
| Triton 24.05 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.05-py3 |
| Triton 24.03 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.03-py3 |
| Triton 24.01 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.01-py3 |
| Triton 23.12 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:23.12-py3 |
StabilityAI PyTorch Inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| StabilityAI 2.0 |
py310 |
cu118 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/stabilityai-pytorch-inference:2.0.1-sgm0.1.0-gpu-py310-cu118-ubuntu20.04-sagemaker |
PyTorch Training Compiler
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 1.13 |
py39 |
cu117 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-trcomp-training:1.13.1-gpu-py39-cu117-ubuntu20.04-sagemaker |
| PyTorch 1.12 |
py38 |
cu113 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-trcomp-training:1.12.0-gpu-py38-cu113-ubuntu20.04-sagemaker |
XGBoost
ECR account IDs for XGBoost vary by region. Refer to SageMaker AI ECR Paths for your region's account ID.
| Framework |
Accelerator |
Platform |
Example URL |
| XGBoost 3.0-5 |
CPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/sagemaker-xgboost:3.0-5 |