AWS Deep Learning Containers for SGLang 0.5.9 on SageMaker¶
AWS Deep Learning Containers for SageMaker are now available with SGLang 0.5.9.
Announcements¶
-
Introduced SGLang 0.5.9 containers for SageMaker
-
Added Python 3.12 support
Core Packages¶
| Package | Version |
|---|---|
| SGLang | 0.5.9 |
| SGLang Kernel | 0.3.21 |
| PyTorch | 2.9.1 |
| TorchVision | 0.24.1 |
| TorchAudio | 2.9.1 |
| TorchAO | 0.9.0 |
| Transformers | 4.57.1 |
| FlashInfer | 0.6.3 |
| CUDA | 12.9.1 |
| cuDNN | 9.16.0.29 |
| NCCL | 2.28.3 |
| EFA | 1.46.0 |
| GDRCopy | 2.5.1 |
Security Advisory¶
AWS recommends that customers monitor critical security updates in the AWS Security Bulletin.
Reference¶
Docker Image URIs¶
763104351884.dkr.ecr.us-west-2.amazonaws.com/sglang:0.5.9-gpu-py312-cu129-ubuntu24.04-sagemaker
763104351884.dkr.ecr.us-west-2.amazonaws.com/sglang:0.5-gpu-py312-cu129-ubuntu24.04-sagemaker-v1
763104351884.dkr.ecr.us-west-2.amazonaws.com/sglang:0.5.9-gpu-py312
763104351884.dkr.ecr.us-west-2.amazonaws.com/sglang:0.5-gpu-py312
public.ecr.aws/deep-learning-containers/sglang:0.5.9-gpu-py312-cu129-ubuntu24.04-sagemaker
public.ecr.aws/deep-learning-containers/sglang:0.5-gpu-py312-cu129-ubuntu24.04-sagemaker-v1
public.ecr.aws/deep-learning-containers/sglang:0.5.9-gpu-py312
public.ecr.aws/deep-learning-containers/sglang:0.5-gpu-py312