Available Images
This page is for referencing our supported Deep Learning Containers.
Refer to the tables below for all images that are available and currently supported in Amazon ECR repositories. For private ECR access and region-specific account IDs, see Region Availability.
Base Containers
Base
These images are also available in ECR Public Gallery: base
| Framework |
Python |
Accelerator |
Platform |
Example URI |
| CUDA 13.2.1 Devel |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:devel-cu132-amzn2023 |
| CUDA 13.2.1 Runtime |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:runtime-cu132-amzn2023 |
| CUDA 13.0.2 Devel |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:devel-cu130-amzn2023 |
| CUDA 13.0.2 Runtime |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:runtime-cu130-amzn2023 |
| CUDA 12.9.1 Devel |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:devel-cu129-amzn2023 |
| CUDA 12.9.1 Runtime |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:runtime-cu129-amzn2023 |
Base (Ubuntu)
These images are also available in ECR Public Gallery: base
| Framework |
Python |
Accelerator |
Platform |
Example URI |
| CUDA 13.0.2 |
py313 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:13.0.2-gpu-py313-cu130-ubuntu22.04-ec2 |
| CUDA 13.0.0 |
py312 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/base:13.0.0-gpu-py312-cu130-ubuntu22.04-ec2 |
LLM Serving
Ray LLM
These images are also available in ECR Public Gallery: ray
Ray LLM images share the ray ECR repository with the Ray Serve and Ray Train images (listed under Framework Containers), and are identified by the serve-llm tag prefix. See the Ray LLM guide.
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| Ray 2.58 |
py313 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-llm-cuda-v1.0 |
SGLang (Ubuntu)
These images are also available in ECR Public Gallery: sglang
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| SGLang 0.5.19 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.19-gpu-py312-cu130-ubuntu24.04-sagemaker |
| SGLang 0.5.19 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.19-gpu-py312-cu130-ubuntu24.04-ec2 |
| SGLang 0.5.18 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.18-gpu-py312-cu130-ubuntu24.04-sagemaker |
| SGLang 0.5.18 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.18-gpu-py312-cu130-ubuntu24.04-ec2 |
| SGLang 0.5.17 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.17-gpu-py312-cu130-ubuntu24.04-sagemaker |
| SGLang 0.5.17 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:0.5.17-gpu-py312-cu130-ubuntu24.04-ec2 |
SGLang
These images are also available in ECR Public Gallery: sglang
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| SGLang 0.5.17+amzn2023.2948168 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:server-sagemaker-cuda-v1.3 |
| SGLang 0.5.17+amzn2023.2948168 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:server-cuda-v1.3 |
| SGLang 0.5.14+amzn2023.bc8b3ab |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:server-sagemaker-cuda-v1.2 |
| SGLang 0.5.14+amzn2023.bc8b3ab |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:server-cuda-v1.2 |
| SGLang 0.5.13+amzn2023.66ab5c9 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:server-sagemaker-cuda-v1.1 |
| SGLang 0.5.13+amzn2023.66ab5c9 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/sglang:server-cuda-v1.1 |
vLLM (Ubuntu)
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| vLLM 0.29.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.29.0-gpu-py312-cu130-ubuntu24.04-sagemaker |
| vLLM 0.29.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.29.0-gpu-py312-cu130-ubuntu24.04-ec2 |
| vLLM 0.28.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.28.0-gpu-py312-cu130-ubuntu24.04-sagemaker |
| vLLM 0.28.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.28.0-gpu-py312-cu130-ubuntu24.04-ec2 |
| vLLM 0.27.1 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.27.1-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.27.1 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.27.1-gpu-py312-cu130-ubuntu22.04-ec2 |
| vLLM 0.26.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.26.0-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.26.0 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.26.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| vLLM 0.25.1 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.25.1-gpu-py312-cu130-ubuntu22.04-sagemaker |
| vLLM 0.25.1 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:0.25.1-gpu-py312-cu130-ubuntu22.04-ec2 |
vLLM
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| vLLM 0.27.1+amzn2023.6adad087 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-sagemaker-cuda-v2.4 |
| vLLM 0.27.1+amzn2023.6adad087 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-cuda-v2.4 |
| vLLM 0.27.0+amzn2023.4bdc8a78 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-sagemaker-cuda-v2.3 |
| vLLM 0.27.0+amzn2023.4bdc8a78 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-cuda-v2.3 |
| vLLM 0.26.0+amzn2023.d223c900 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-sagemaker-cuda-v2.2 |
| vLLM 0.26.0+amzn2023.d223c900 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-cuda-v2.2 |
| vLLM 0.24.0+amzn2023.7b3d595e |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-sagemaker-cuda-v2.1 |
| vLLM 0.24.0+amzn2023.7b3d595e |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-cuda-v2.1 |
| vLLM 0.22.1rc0+amzn2023.6aabe221 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-sagemaker-cuda-v2.0 |
| vLLM 0.22.1rc0+amzn2023.6aabe221 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:server-cuda-v2.0 |
vLLM ARM64
These images are also available in ECR Public Gallery: vllm-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| vLLM 0.10.2 |
py312 |
cu129 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm-arm64:0.10.2-gpu-py312-cu129-ubuntu22.04-ec2 |
vLLM-Omni
These images are also available in ECR Public Gallery: vllm
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| vLLM-Omni 0.26.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.5 |
| vLLM-Omni 0.26.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.6 |
| vLLM-Omni 0.26.0 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.5 |
| vLLM-Omni 0.26.0 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.6 |
| vLLM-Omni 0.21.0rc1 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.3 |
| vLLM-Omni 0.21.0rc1 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.4 |
| vLLM-Omni 0.21.0rc1 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.3 |
| vLLM-Omni 0.21.0rc1 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.4 |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.1 |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-sagemaker-cuda-v1.2 |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.1 |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/vllm:omni-cuda-v1.2 |
llama.cpp
These images are also available in ECR Public Gallery: llama-cpp
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| llama.cpp 1.0.0+b10433 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/llama-cpp:server-sagemaker-cuda-v1 |
| llama.cpp 1.0.0+b10433 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/llama-cpp:server-sagemaker-cpu-v1 |
| llama.cpp 1.0.0+b10433 |
py312 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/llama-cpp:server-cuda-v1 |
| llama.cpp 1.0.0+b10433 |
py312 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/llama-cpp:server-cpu-v1 |
llama.cpp ARM64
These images are also available in ECR Public Gallery: llama-cpp-arm64
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| llama.cpp 1.0.0+b10433 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/llama-cpp-arm64:server-sagemaker-cpu-v1 |
| llama.cpp 1.0.0+b10433 |
py312 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/llama-cpp-arm64:server-cpu-v1 |
NVIDIA Triton Server for SageMaker
| Framework |
Python |
Accelerator |
Platform |
Example URI |
| Triton 26.05 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:26.05-py3 |
| Triton 26.04 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:26.04-py3 |
| Triton 26.03 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:26.03-py3 |
| Triton 25.09 |
py3 |
GPU |
SageMaker |
007439368137.dkr.ecr.<region>.amazonaws.com/sagemaker-tritonserver:25.09-py3 |
Framework Containers
Ray Serve
These images are also available in ECR Public Gallery: ray
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| Ray 2.57 |
py313 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cuda-v1 |
| Ray 2.57 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cpu-v1 |
| Ray 2.57 |
py313 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cuda-v1 |
| Ray 2.57 |
py313 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cpu-v1 |
| Ray 2.56 |
py313 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cuda-v1.3 |
| Ray 2.56 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cpu-v1.3 |
| Ray 2.56 |
py313 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cuda-v1.3 |
| Ray 2.56 |
py313 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cpu-v1.3 |
| Ray 2.55 |
py313 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cuda-v1.1 |
| Ray 2.55 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cpu-v1.1 |
| Ray 2.55 |
py313 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cuda-v1.1 |
| Ray 2.55 |
py313 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cpu-v1.1 |
| Ray 2.54 |
py313 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cuda-v1.0 |
| Ray 2.54 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-sagemaker-cpu-v1.0 |
| Ray 2.54 |
py313 |
cu129 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cuda-v1.0 |
| Ray 2.54 |
py313 |
- |
CPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:serve-ml-cpu-v1.0 |
Ray Train
These images are also available in ECR Public Gallery: ray
Ray Train images share the ray ECR repository with the Ray Serve and Ray LLM images above and are identified by the train-ml tag prefix. See the Ray Train guide.
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| Ray 2.58 |
py313 |
cu130 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/ray:train-ml-cuda-v1.0 |
PyTorch
These images are also available in ECR Public Gallery: pytorch
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| PyTorch 2.13 |
py312 |
cu133 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.13.0-cu133-amzn2023-sagemaker |
| PyTorch 2.13 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.13.0-cpu-amzn2023-sagemaker |
| PyTorch 2.13 |
py312 |
cu133 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.13.0-cu133-amzn2023 |
| PyTorch 2.13 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.13.0-cpu-amzn2023 |
| PyTorch 2.12 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.12.1-cu130-amzn2023-sagemaker |
| PyTorch 2.12 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.12.1-cpu-amzn2023-sagemaker |
| PyTorch 2.12 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.12.1-cu130-amzn2023 |
| PyTorch 2.12 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.12.1-cpu-amzn2023 |
| PyTorch 2.11 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.11.0-cu130-amzn2023-sagemaker |
| PyTorch 2.11 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.11.0-cpu-amzn2023-sagemaker |
| PyTorch 2.11 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.11.0-cu130-amzn2023 |
| PyTorch 2.11 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch:2.11.0-cpu-amzn2023 |
PyTorch Training
These images are also available in ECR Public Gallery: pytorch-training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| PyTorch 2.10 |
py313 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-gpu-py313-cu130-ubuntu22.04-sagemaker |
| PyTorch 2.10 |
py313 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-cpu-py313-ubuntu22.04-sagemaker |
| PyTorch 2.10 |
py313 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-gpu-py313-cu130-ubuntu22.04-ec2 |
| PyTorch 2.10 |
py313 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.10.0-cpu-py313-ubuntu22.04-ec2 |
| PyTorch 2.9 |
py312 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-gpu-py312-cu130-ubuntu22.04-sagemaker |
| PyTorch 2.9 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-cpu-py312-ubuntu22.04-sagemaker |
| PyTorch 2.9 |
py312 |
cu130 |
GPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-gpu-py312-cu130-ubuntu22.04-ec2 |
| PyTorch 2.9 |
py312 |
- |
CPU |
EC2, ECS, EKS |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:2.9.0-cpu-py312-ubuntu22.04-ec2 |
TensorFlow Training
These images are also available in ECR Public Gallery: tensorflow-training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| TensorFlow 2.21 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-training:2.21.0-gpu-py312-cu129-amzn2023-sagemaker |
| TensorFlow 2.21 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-training:2.21.0-cpu-py312-amzn2023-sagemaker |
TensorFlow Inference
These images are also available in ECR Public Gallery: tensorflow-inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| TensorFlow 2.20 |
py312 |
cu129 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference:2.20.0-gpu-py312-cu129-amzn2023-sagemaker |
| TensorFlow 2.20 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference:2.20.0-cpu-py312-amzn2023-sagemaker |
WhisperX
These images are also available in ECR Public Gallery: whisperx
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| WhisperX 3.8.6 |
py312 |
cu128 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/whisperx:3.8.6-cu128-amzn2023-sagemaker |
| WhisperX 3.8.6 |
py312 |
cu128 |
GPU |
EC2 |
763104351884.dkr.ecr.<region>.amazonaws.com/whisperx:3.8.6-cu128-amzn2023 |
Hugging Face
HuggingFace PyTorch Training
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| PyTorch 2.9 |
py312 |
cu130 |
5.3.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.9.0-transformers5.3.0-gpu-py312-cu130-ubuntu22.04 |
| PyTorch 2.5 |
py311 |
cu124 |
4.49.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.5.1-transformers4.49.0-gpu-py311-cu124-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
cu121 |
4.36.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.1.0-transformers4.36.0-gpu-py310-cu121-ubuntu20.04 |
| PyTorch 2.0 |
py310 |
cu118 |
4.28.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:2.0.0-transformers4.28.1-gpu-py310-cu118-ubuntu20.04 |
| PyTorch 1.13 |
py39 |
cu117 |
4.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training:1.13.1-transformers4.26.0-gpu-py39-cu117-ubuntu20.04 |
HuggingFace PyTorch Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| PyTorch 2.6 |
py312 |
cu124 |
5.5.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.6.0-transformers5.5.3-gpu-py312-cu124-ubuntu22.04 |
| PyTorch 2.6 |
py312 |
- |
5.5.3 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.6.0-transformers5.5.3-cpu-py312-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
cu118 |
4.37.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-gpu-py310-cu118-ubuntu20.04 |
| PyTorch 2.1 |
py310 |
- |
4.37.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-cpu-py310-ubuntu22.04 |
HuggingFace Llama.cpp
| Framework |
CUDA |
Accelerator |
Platform |
Example URI |
| Llama.cpp b9522 |
cu130 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-llamacpp:b9522-gpu-cu130-ubuntu24.04 |
| Llama.cpp b9522 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-llamacpp:b9522-cpu-ubuntu24.04 |
HuggingFace vLLM Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| vLLM 0.28.0 |
py312 |
cu130 |
5.15.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.28.0-transformers5.15.0-gpu-py312-cu130-ubuntu24.04 |
| vLLM 0.27.1 |
py312 |
cu130 |
5.10.2 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.27.1-transformers5.10.2-gpu-py312-cu130-ubuntu22.04 |
| vLLM 0.26.0 |
py312 |
cu130 |
5.10.2 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.26.0-transformers5.10.2-gpu-py312-cu130-ubuntu22.04 |
| vLLM 0.25.1 |
py312 |
cu130 |
5.10.2 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.25.1-transformers5.10.2-gpu-py312-cu130-ubuntu22.04 |
| vLLM 0.22.1 |
py312 |
cu130 |
5.10.2 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.22.1-transformers5.10.2-gpu-py312-cu130-ubuntu22.04 |
| vLLM 0.21.0 |
py312 |
cu130 |
5.8.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.21.0-transformers5.8.1-gpu-py312-cu130-ubuntu22.04 |
| vLLM 0.17.0 |
py312 |
cu129 |
4.57.5 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.17.0-transformers4.57.5-gpu-py312-cu129-ubuntu22.04 |
| vLLM 0.14.0 |
py312 |
cu129 |
4.57.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm:0.14.0-transformers4.57.3-gpu-py312-cu129-ubuntu22.04 |
HuggingFace vLLM-Omni Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| vLLM-Omni 0.20.0 |
py312 |
cu130 |
5.8.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm-omni:0.20.0-transformers5.8.1-gpu-py312-cu130-amzn2023 |
HuggingFace SGLang Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| SGLang 0.5.8 |
py312 |
cu129 |
4.57.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-sglang:0.5.8-transformers4.57.3-gpu-py312-cu129-ubuntu24.04 |
HuggingFace Text Embeddings Inference
ECR account IDs for Text Embeddings Inference vary by region. See Region Availability for your region's account ID.
| Framework |
CUDA |
Accelerator |
Platform |
Example URI |
| TEI 1.9.3 |
cu129 |
GPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/tei:2.0.1-tei1.9.3-gpu-py310-cu129-ubuntu24.04 |
| TEI 1.9.3 |
- |
CPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/tei-cpu:2.0.1-tei1.9.3-cpu-py310-ubuntu24.04 |
HuggingFace TensorFlow Training
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| TensorFlow 2.6 |
py38 |
cu112 |
4.17.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-training:2.6.3-transformers4.17.0-gpu-py38-cu112-ubuntu20.04 |
HuggingFace TensorFlow Inference
| Framework |
Python |
CUDA |
Transformers |
Accelerator |
Platform |
Example URI |
| TensorFlow 2.11 |
py39 |
cu112 |
4.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-inference:2.11.1-transformers4.26.0-gpu-py39-cu112-ubuntu20.04 |
| TensorFlow 2.11 |
py39 |
- |
4.26.0 |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-tensorflow-inference:2.11.1-transformers4.26.0-cpu-py39-ubuntu20.04 |
NeuronX (Trainium / Inferentia)
PyTorch Training NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URI |
| PyTorch 2.9 |
py312 |
2.27.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.28.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.28.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.29.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.29.1-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.30.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.30.0-ubuntu24.04 |
| PyTorch 2.8 |
py311 |
2.26.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.25.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
| PyTorch 2.6 |
py310 |
2.23.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training-neuronx:2.6.0-neuronx-py310-sdk2.23.0-ubuntu22.04 |
PyTorch Inference NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URI |
| PyTorch 2.9 |
py312 |
2.27.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.28.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.28.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.29.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.29.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.29.1-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.30.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.30.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.31.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.31.0-ubuntu24.04 |
| PyTorch 2.9 |
py312 |
2.31.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.31.1-ubuntu24.04 |
| PyTorch 2.8 |
py311 |
2.26.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.25.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
| PyTorch 2.6 |
py310 |
2.23.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-inference-neuronx:2.6.0-neuronx-py310-sdk2.23.0-ubuntu22.04 |
TensorFlow Inference NeuronX
| Framework |
Python |
SDK |
Accelerator |
Platform |
Example URI |
| TensorFlow 2.10 |
py310 |
2.17.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/tensorflow-inference-neuronx:2.10.1-neuronx-py310-sdk2.17.0-ubuntu20.04 |
HuggingFace vLLM Inference NeuronX
| Framework |
Python |
SDK |
Optimum |
Accelerator |
Platform |
Example URI |
| vLLM 0.11 |
py310 |
2.26.1 |
0.4.5 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-vllm-inference-neuronx:0.11.0-optimum0.4.5-neuronx-py310-sdk2.26.1-ubuntu22.04 |
HuggingFace PyTorch Training NeuronX
| Framework |
Python |
SDK |
Transformers |
Accelerator |
Platform |
Example URI |
| PyTorch 2.8 |
py310 |
2.26.0 |
4.55.4 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
4.51.0 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.7.0-transformers4.51.0-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
2.20.0 |
4.48.1 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.48.1-neuronx-py310-sdk2.20.0-ubuntu20.04 |
HuggingFace PyTorch Inference NeuronX
| Framework |
Python |
SDK |
Transformers |
Accelerator |
Platform |
Example URI |
| PyTorch 2.8 |
py310 |
2.26.0 |
4.55.4 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.8.0-transformers4.55.4-neuronx-py310-sdk2.26.0-ubuntu22.04 |
| PyTorch 2.7 |
py310 |
2.24.1 |
4.51.3 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.7.1-transformers4.51.3-neuronx-py310-sdk2.24.1-ubuntu22.04 |
| PyTorch 2.1 |
py310 |
2.20.0 |
4.43.2 |
NeuronX |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.43.2-neuronx-py310-sdk2.20.0-ubuntu20.04 |
AutoGluon
AutoGluon Training
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| AutoGluon 1.5 |
py312 |
cu126 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.5.0-gpu-py312-cu126-ubuntu22.04 |
| AutoGluon 1.5 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.5.0-cpu-py312-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.4.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-training:1.4.0-cpu-py311-ubuntu22.04 |
AutoGluon Inference
| Framework |
Python |
CUDA |
Accelerator |
Platform |
Example URI |
| AutoGluon 1.5 |
py312 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.5.0-gpu-py312-cu124-ubuntu22.04 |
| AutoGluon 1.5 |
py312 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.5.0-cpu-py312-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
cu124 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.4.0-gpu-py311-cu124-ubuntu22.04 |
| AutoGluon 1.4 |
py311 |
- |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/autogluon-inference:1.4.0-cpu-py311-ubuntu22.04 |
DJL Inference
DJL Inference
| Framework |
CUDA |
Engine |
Accelerator |
Platform |
Example URI |
| DJLServing 0.36 |
cu130 |
LMI 28.0.0, vLLM 0.26.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi28.0.0-cu130 |
| DJLServing 0.36 |
cu130 |
LMI 27.0.0, vLLM 0.23.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi27.0.0-cu130 |
| DJLServing 0.36 |
cu130 |
LMI 26.0.0, vLLM 0.22.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi26.0.0-cu130 |
| DJLServing 0.36 |
cu130 |
LMI 25.0.0, vLLM 0.20.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi25.0.0-cu130 |
| DJLServing 0.36 |
cu129 |
LMI 24.0.0, vLLM 0.19.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi24.0.0-cu129 |
| DJLServing 0.36 |
cu129 |
LMI 23.0.0, vLLM 0.18.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi23.0.0-cu129 |
| DJLServing 0.36 |
cu129 |
LMI 22.0.0, vLLM 0.17.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi22.0.0-cu129 |
| DJLServing 0.36 |
cu129 |
LMI 21.0.0, vLLM 0.16.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi21.0.0-cu129 |
| DJLServing 0.36 |
cu128 |
LMI 20.0.0, vLLM 0.15.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi20.0.0-cu128 |
| DJLServing 0.36 |
cu128 |
LMI 19.0.0, vLLM 0.14.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi19.0.0-cu128 |
| DJLServing 0.36 |
cu128 |
LMI 18.0.0, vLLM 0.12.0 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-lmi18.0.0-cu128 |
| DJLServing 0.36 |
- |
CPU Full |
CPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.36.0-cpu-full |
| DJLServing 0.35 |
cu128 |
LMI 17.0.0, vLLM 0.11.1 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.35.0-lmi17.0.0-cu128 |
| DJLServing 0.34 |
cu128 |
LMI 16.0.0, vLLM 0.10.2 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.34.0-lmi16.0.0-cu128 |
| DJLServing 0.33 |
cu128 |
LMI 15.0.0, vLLM 0.8.4 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.33.0-lmi15.0.0-cu128 |
| DJLServing 0.32 |
cu126 |
LMI 14.0.0, vLLM 0.6.3 |
GPU |
SageMaker |
763104351884.dkr.ecr.<region>.amazonaws.com/djl-inference:0.32.0-lmi14.0.0-cu126 |
SageMaker Algorithm Containers
Scikit-Learn
ECR account IDs for Scikit-Learn vary by region. See Region Availability for your region's account ID.
| Framework |
Accelerator |
Platform |
Example URI |
| Scikit-Learn 1.9-0 |
CPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/sagemaker-scikit-learn:1.9-0 |
| Scikit-Learn 1.4-2-py312 |
CPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/sagemaker-scikit-learn:1.4-2-py312 |
XGBoost
ECR account IDs for XGBoost vary by region. See Region Availability for your region's account ID.
| Framework |
Accelerator |
Platform |
Example URI |
| XGBoost 3.2-0 |
CPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/sagemaker-xgboost:3.2-0 |
| XGBoost 3.0-5 |
CPU |
SageMaker |
<account-id>.dkr.ecr.<region>.amazonaws.com/sagemaker-xgboost:3.0-5 |