Available Images
This page is for referencing our supported Deep Learning Containers.
Refer to the tables below for all images that are available in Amazon ECR repositories.
Region Availability
| Region |
Code |
General |
Neuron |
Example URL |
| US East (Ohio) |
us-east-2 |
✅ |
✅ |
763104351884.dkr.ecr.us-east-2.amazonaws.com/<repository-name>:<image-tag> |
| US East (N. Virginia) |
us-east-1 |
✅ |
✅ |
763104351884.dkr.ecr.us-east-1.amazonaws.com/<repository-name>:<image-tag> |
| US West (N. California) |
us-west-1 |
✅ |
❌ |
763104351884.dkr.ecr.us-west-1.amazonaws.com/<repository-name>:<image-tag> |
| US West (Oregon) |
us-west-2 |
✅ |
✅ |
763104351884.dkr.ecr.us-west-2.amazonaws.com/<repository-name>:<image-tag> |
| Africa (Cape Town) |
af-south-1 |
✅ |
❌ |
626614931356.dkr.ecr.af-south-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Hong Kong) |
ap-east-1 |
✅ |
❌ |
871362719292.dkr.ecr.ap-east-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Hyderabad) |
ap-south-2 |
✅ |
❌ |
772153158452.dkr.ecr.ap-south-2.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Jakarta) |
ap-southeast-3 |
✅ |
❌ |
907027046896.dkr.ecr.ap-southeast-3.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Malaysia) |
ap-southeast-5 |
✅ |
❌ |
550225433462.dkr.ecr.ap-southeast-5.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Melbourne) |
ap-southeast-4 |
✅ |
❌ |
457447274322.dkr.ecr.ap-southeast-4.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Mumbai) |
ap-south-1 |
✅ |
✅ |
763104351884.dkr.ecr.ap-south-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Osaka) |
ap-northeast-3 |
✅ |
❌ |
364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Seoul) |
ap-northeast-2 |
✅ |
❌ |
763104351884.dkr.ecr.ap-northeast-2.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Singapore) |
ap-southeast-1 |
✅ |
✅ |
763104351884.dkr.ecr.ap-southeast-1.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Sydney) |
ap-southeast-2 |
✅ |
✅ |
763104351884.dkr.ecr.ap-southeast-2.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Taipei) |
ap-east-2 |
✅ |
✅ |
763104351884.dkr.ecr.ap-east-2.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Thailand) |
ap-southeast-7 |
✅ |
❌ |
590183813437.dkr.ecr.ap-southeast-7.amazonaws.com/<repository-name>:<image-tag> |
| Asia Pacific (Tokyo) |
ap-northeast-1 |
✅ |
✅ |
763104351884.dkr.ecr.ap-northeast-1.amazonaws.com/<repository-name>:<image-tag> |
| Canada (Central) |
ca-central-1 |
✅ |
❌ |
763104351884.dkr.ecr.ca-central-1.amazonaws.com/<repository-name>:<image-tag> |
| Canada (Calgary) |
ca-west-1 |
✅ |
❌ |
204538143572.dkr.ecr.ca-west-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Frankfurt) |
eu-central-1 |
✅ |
✅ |
763104351884.dkr.ecr.eu-central-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Ireland) |
eu-west-1 |
✅ |
✅ |
763104351884.dkr.ecr.eu-west-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (London) |
eu-west-2 |
✅ |
❌ |
763104351884.dkr.ecr.eu-west-2.amazonaws.com/<repository-name>:<image-tag> |
| EU (Milan) |
eu-south-1 |
✅ |
❌ |
692866216735.dkr.ecr.eu-south-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Paris) |
eu-west-3 |
✅ |
✅ |
763104351884.dkr.ecr.eu-west-3.amazonaws.com/<repository-name>:<image-tag> |
| EU (Spain) |
eu-south-2 |
✅ |
❌ |
503227376785.dkr.ecr.eu-south-2.amazonaws.com/<repository-name>:<image-tag> |
| EU (Stockholm) |
eu-north-1 |
✅ |
❌ |
763104351884.dkr.ecr.eu-north-1.amazonaws.com/<repository-name>:<image-tag> |
| EU (Zurich) |
eu-central-2 |
✅ |
❌ |
380420809688.dkr.ecr.eu-central-2.amazonaws.com/<repository-name>:<image-tag> |
| Israel (Tel Aviv) |
il-central-1 |
✅ |
❌ |
780543022126.dkr.ecr.il-central-1.amazonaws.com/<repository-name>:<image-tag> |
| Mexico (Central) |
mx-central-1 |
✅ |
❌ |
637423239942.dkr.ecr.mx-central-1.amazonaws.com/<repository-name>:<image-tag> |
| Middle East (Bahrain) |
me-south-1 |
✅ |
❌ |
217643126080.dkr.ecr.me-south-1.amazonaws.com/<repository-name>:<image-tag> |
| Middle East (UAE) |
me-central-1 |
✅ |
❌ |
914824155844.dkr.ecr.me-central-1.amazonaws.com/<repository-name>:<image-tag> |
| South America (Sao Paulo) |
sa-east-1 |
✅ |
✅ |
763104351884.dkr.ecr.sa-east-1.amazonaws.com/<repository-name>:<image-tag> |
| China (Beijing) |
cn-north-1 |
✅ |
❌ |
727897471807.dkr.ecr.cn-north-1.amazonaws.com.cn/<repository-name>:<image-tag> |
| China (Ningxia) |
cn-northwest-1 |
✅ |
❌ |
727897471807.dkr.ecr.cn-northwest-1.amazonaws.com.cn/<repository-name>:<image-tag> |
Base
These images are also available in ECR Public Gallery: base
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| Base 13.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:13.0.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| Base 12.9 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.9.1-gpu-py312-cu129-ubuntu22.04-ec2 |
| Base 12.8.1 |
py312 |
cu128 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.8.1-gpu-py312-cu128-ubuntu24.04-ec2 |
| Base 12.8.0 |
py312 |
cu128 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:12.8.0-gpu-py312-cu128-ubuntu22.04-ec2 |
SGLang
These images are also available in ECR Public Gallery: sglang
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| SGLang 0.5.8 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.8-gpu-py312-cu129-ubuntu24.04-sagemaker |
| SGLang 0.5.7 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.7-gpu-py312-cu129-ubuntu24.04-sagemaker |
| SGLang 0.5.6 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.6-gpu-py312-cu129-ubuntu22.04-sagemaker |
| SGLang 0.5.5 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.5-gpu-py312-cu129-ubuntu22.04-sagemaker |
vLLM
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| vLLM 0.14.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.14.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.14.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.14.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| vLLM 0.13.0 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.13.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| vLLM 0.13.0 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.13.0-gpu-py312-cu129-ubuntu22.04-ec2 |
vLLM ARM64
These images are also available in ECR Public Gallery: vllm-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| vLLM 0.10.2 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm-arm64:0.10.2-gpu-py312-cu129-ubuntu22.04-ec2 |
PyTorch Training
These images are also available in ECR Public Gallery: pytorch-training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 2.9 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-gpu-py312-cu130-ubuntu22.04-sagemaker |
| PyTorch 2.9 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.9 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| PyTorch 2.9 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-cpu-py312-ubuntu22.04-ec2 |
| PyTorch 2.8 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-gpu-py312-cu129-ubuntu22.04-sagemaker |
| PyTorch 2.8 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.8 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-gpu-py312-cu129-ubuntu22.04-ec2 |
| PyTorch 2.8 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.8.0-cpu-py312-ubuntu22.04-ec2 |
| PyTorch 2.7 |
py312 |
cu128 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.7.1-gpu-py312-cu128-ubuntu22.04-sagemaker |
| PyTorch 2.7 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.7.1-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.7 |
py312 |
cu128 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.7.1-gpu-py312-cu128-ubuntu22.04-ec2 |
| PyTorch 2.7 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.7.1-cpu-py312-ubuntu22.04-ec2 |
PyTorch Training ARM64
These images are also available in ECR Public Gallery: pytorch-training-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 2.7 |
py312 |
cu128 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-arm64:2.7.0-gpu-py312-cu128-ubuntu22.04-ec2 |
TensorFlow Training
These images are also available in ECR Public Gallery: tensorflow-training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.19 |
py312 |
cu125 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-training:2.19.0-gpu-py312-cu125-ubuntu22.04-sagemaker |
| TensorFlow 2.19 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-training:2.19.0-cpu-py312-ubuntu22.04-sagemaker |
TensorFlow Inference
These images are also available in ECR Public Gallery: tensorflow-inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.19 |
py312 |
cu122 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference:2.19.0-gpu-py312-cu122-ubuntu22.04-sagemaker |
| TensorFlow 2.19 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference:2.19.0-cpu-py312-ubuntu22.04-sagemaker |
TensorFlow Inference ARM64
These images are also available in ECR Public Gallery: tensorflow-inference-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.19 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference-arm64:2.19.0-cpu-py312-ubuntu22.04-sagemaker |
PyTorch Training NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URL |
| PyTorch 2.9 |
py312 |
2.27.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
| PyTorch 2.8 |
py311 |
2.26.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.25.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
| PyTorch 2.6 |
py310 |
2.23.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.6.0-neuronx-py310-sdk2.23.0-ubuntu22.04 |
PyTorch Inference NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URL |
| PyTorch 2.9 |
py312 |
2.27.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
| PyTorch 2.8 |
py311 |
2.26.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.25.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
| PyTorch 2.6 |
py310 |
2.23.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.6.0-neuronx-py310-sdk2.23.0-ubuntu22.04 |
TensorFlow Inference NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.10 |
py310 |
2.17.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference-neuronx:2.10.1-neuronx-py310-sdk2.17.0-ubuntu20.04 |
HuggingFace PyTorch Training
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.5 |
py311 |
cu124 |
4.49.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.5.1-transformers4.49.0-gpu-py311-cu124-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
cu121 |
4.36.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.1.0-transformers4.36.0-gpu-py310-cu121-ubuntu20.04 |
| PyTorch 2.0 |
py310 |
cu118 |
4.28.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.0.0-transformers4.28.1-gpu-py310-cu118-ubuntu20.04 |
| PyTorch 1.13 |
py39 |
cu117 |
4.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:1.13.1-transformers4.26.0-gpu-py39-cu117-ubuntu20.04 |
HuggingFace PyTorch Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.6 |
py312 |
cu124 |
4.49.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.6.0-transformers4.49.0-gpu-py312-cu124-ubuntu22.04 |
| PyTorch 2.6 |
py312 |
- |
4.49.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.6.0-transformers4.49.0-cpu-py312-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
cu118 |
4.37.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-gpu-py310-cu118-ubuntu20.04 |
| PyTorch 2.1 |
py310 |
- |
4.37.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-cpu-py310-ubuntu22.04 |
HuggingFace PyTorch Training NeuronX
| Framework |
Python |
SDK |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.8 |
py310 |
2.26.0 |
4.55.4 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
4.51.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.7.0-transformers4.51.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
2.20.0 |
4.48.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.48.1-neuronx-py310-sdk2.20.0-ubuntu20.04 |
HuggingFace PyTorch Inference NeuronX
| Framework |
Python |
SDK |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 2.8 |
py310 |
2.26.0 |
4.55.4 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
4.51.3 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.7.1-transformers4.51.3-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
2.20.0 |
4.43.2 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.43.2-neuronx-py310-sdk2.20.0-ubuntu20.04 |
HuggingFace PyTorch Training Compiler
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| PyTorch 1.11 |
py38 |
cu113 |
4.21.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-trcomp-training:1.11.0-transformers4.21.1-gpu-py38-cu113-ubuntu20.04 |
HuggingFace TensorFlow Training
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.6 |
py38 |
cu112 |
4.17.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-training:2.6.3-transformers4.17.0-gpu-py38-cu112-ubuntu20.04 |
HuggingFace TensorFlow Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URL |
| TensorFlow 2.11 |
py39 |
cu112 |
4.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-inference:2.11.1-transformers4.26.0-gpu-py39-cu112-ubuntu20.04 |
| TensorFlow 2.11 |
py39 |
- |
4.26.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-inference:2.11.1-transformers4.26.0-cpu-py39-ubuntu20.04 |
AutoGluon Training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| AutoGluon 1.4 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.4.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.4.0-cpu-py311-ubuntu22.04 |
| AutoGluon 1.3 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.3.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.3 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.3.0-cpu-py311-ubuntu22.04 |
AutoGluon Inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| AutoGluon 1.4 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.4.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.4.0-cpu-py311-ubuntu22.04 |
| AutoGluon 1.3 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.3.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.3 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.3.0-cpu-py311-ubuntu22.04 |
DJL Inference
| Framework |
CUDA |
Engine |
Accelerator |
Platform |
Example URL |
| DJLServing 0.36 |
cu128 |
LMI 20.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi20.0.0-cu128-v1.0 |
| DJLServing 0.36 |
cu128 |
LMI 19.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi19.0.0-cu128 |
| DJLServing 0.36 |
cu128 |
LMI 18.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi18.0.0-cu128 |
| DJLServing 0.36 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-cpu-full |
| DJLServing 0.35 |
cu128 |
LMI 17.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.35.0-lmi17.0.0-cu128 |
| DJLServing 0.35 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.35.0-cpu-full |
| DJLServing 0.34 |
cu128 |
LMI 16.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.34.0-lmi16.0.0-cu128 |
| DJLServing 0.33 |
cu128 |
LMI 15.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.33.0-lmi15.0.0-cu128 |
| DJLServing 0.33 |
cu128 |
TensorRT-LLM 0.21.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.33.0-tensorrtllm0.21.0-cu128 |
| DJLServing 0.32 |
cu126 |
LMI 14.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.32.0-lmi14.0.0-cu126 |
| DJLServing 0.32 |
cu125 |
TensorRT-LLM 0.12.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.32.0-tensorrtllm0.12.0-cu125 |
| DJLServing 0.31 |
cu124 |
LMI 13.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.31.0-lmi13.0.0-cu124 |
| DJLServing 0.30 |
cu124 |
LMI 12.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.30.0-lmi12.0.0-cu124 |
| DJLServing 0.30 |
cu125 |
TensorRT-LLM 0.12.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.30.0-tensorrtllm0.12.0-cu125 |
| DJLServing 0.29 |
cu124 |
LMI 11.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.29.0-lmi11.0.0-cu124 |
| DJLServing 0.29 |
cu124 |
TensorRT-LLM 0.11.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.29.0-tensorrtllm0.11.0-cu124 |
| DJLServing 0.29 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.29.0-cpu-full |
| DJLServing 0.28 |
cu124 |
LMI 10.0.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.28.0-lmi10.0.0-cu124 |
| DJLServing 0.28 |
cu122 |
TensorRT-LLM 0.9.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.28.0-tensorrtllm0.9.0-cu122 |
| DJLServing 0.28 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.28.0-cpu-full |
| DJLServing 0.27 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.27.0-cpu-full |
NVIDIA Triton Server for SageMaker
| Framework |
Python |
Accelerator |
Platform |
Example URL |
| Triton 25.09 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:25.09-py3 |
| Triton 25.04 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:25.04-py3 |
| Triton 24.09 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.09-py3 |
| Triton 24.05 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.05-py3 |
| Triton 24.03 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.03-py3 |
| Triton 24.01 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:24.01-py3 |
| Triton 23.12 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:23.12-py3 |
StabilityAI PyTorch Inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| StabilityAI 2.0 |
py310 |
cu118 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/stabilityai-pytorch-inference:2.0.1-sgm0.1.0-gpu-py310-cu118-ubuntu20.04-sagemaker |
PyTorch Training Compiler
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URL |
| PyTorch 1.13 |
py39 |
cu117 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-trcomp-training:1.13.1-gpu-py39-cu117-ubuntu20.04-sagemaker |
| PyTorch 1.12 |
py38 |
cu113 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-trcomp-training:1.12.0-gpu-py38-cu113-ubuntu20.04-sagemaker |