Skip to content

Commit 6776548

Browse files
arjramanarjraman
authored
Update README for 2.28 release (#188)
*Issue #, if available:* *Description of changes:* By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
1 parent 033cc6a commit 6776548

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

‎README.md‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,7 @@ For detailed customization examples and best practices, refer to the [Neuron DLC
3939

4040
| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | Other Packages |
4141
|-----------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------|--------------------|------------------------------|------------------------|--------------------------------------------------------------------------------------------|-------------------|
42+
| [PyTorch 2.9.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.28.0/pytorch/inference/2.9.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_inference, torch-neuronx | Neuron 2.28.0 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.28.0-ubuntu24.04 | torchserve 0.11.0 |
4243
| [PyTorch 2.9.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.27.1/pytorch/inference/2.9.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_inference, torch-neuronx | Neuron 2.27.1 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 | torchserve 0.11.0 |
4344
| [PyTorch 2.8.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.26.1/pytorch/inference/2.8.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_inference, torch-neuronx | Neuron 2.26.1 | trn1,trn2,inf2 | 3.11 (py311) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 | torchserve 0.11.0 |
4445
| [PyTorch 2.7.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.25.0/docker/pytorch/inference/2.7.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_inference, torch-neuronx, transformers-neuronx | Neuron 2.25.0 | trn1,trn2,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 | torchserve 0.11.0 |
@@ -51,6 +52,7 @@ For detailed customization examples and best practices, refer to the [Neuron DLC
5152

5253
| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL |
5354
|----------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------|--------------------|------------------------------|------------------------|-------------------------------------------------------------------------------------------|
55+
| [PyTorch 2.9.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.28.0/pytorch/training/2.9.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.28.0 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.28.0-ubuntu24.04 |
5456
| [PyTorch 2.9.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.27.1/pytorch/training/2.9.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.27.1 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-training-neuronx:2.9.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
5557
| [PyTorch 2.8.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.26.1/pytorch/training/2.8.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.26.1 | trn1,trn2,inf2 | 3.11 (py311) | public.ecr.aws/neuron/pytorch-training-neuronx:2.8.0-neuronx-py311-sdk2.26.1-ubuntu22.04 |
5658
| [PyTorch 2.7.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.25.0/docker/pytorch/training/2.7.0/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.25.0 | trn1,trn2,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:2.7.0-neuronx-py310-sdk2.25.0-ubuntu22.04 |
@@ -63,6 +65,7 @@ For detailed customization examples and best practices, refer to the [Neuron DLC
6365

6466
| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | Other Packages |
6567
|----------------------------------------------------------------------------------------------------------------------------------------|---------------------------------|--------------------|------------------------------|------------------------|------------------------------------------------------------------------------------------|-------------------|
68+
| [JAX 0.7](https://github.com/aws-neuron/deep-learning-containers/blob/2.28.0/jax/training/0.7/Dockerfile.neuronx) | jax-neuronx, libneuronxla | Neuron 2.28.0 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/jax-training-neuronx:0.7-neuronx-py312-sdk2.28.0-ubuntu24.04 | jaxlib 0.7 |
6669
| [JAX 0.7](https://github.com/aws-neuron/deep-learning-containers/blob/2.27.1/jax/training/0.7/Dockerfile.neuronx) | jax-neuronx, libneuronxla | Neuron 2.27.1 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/jax-training-neuronx:0.7-neuronx-py312-sdk2.27.1-ubuntu24.04 | jaxlib 0.7 |
6770
| [JAX 0.6](https://github.com/aws-neuron/deep-learning-containers/blob/2.26.1/jax/training/0.6/Dockerfile.neuronx) | jax-neuronx, libneuronxla | Neuron 2.26.1 | trn1,trn2,inf2 | 3.11 (py311) | public.ecr.aws/neuron/jax-training-neuronx:0.6-neuronx-py311-sdk2.26.1-ubuntu22.04 | jaxlib 0.6 |
6871
| [JAX 0.6](https://github.com/aws-neuron/deep-learning-containers/blob/2.25.0/docker/jax/training/0.6/Dockerfile.neuronx) | jax-neuronx, libneuronxla | Neuron 2.25.0 | trn1,trn2,inf2 | 3.10 (py310) | public.ecr.aws/neuron/jax-training-neuronx:0.6-neuronx-py310-sdk2.25.0-ubuntu22.04 | jaxlib 0.6 |
@@ -72,6 +75,7 @@ For detailed customization examples and best practices, refer to the [Neuron DLC
7275

7376
| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL |
7477
|----------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------|--------------------|------------------------------|------------------------|-------------------------------------------------------------------------------------------|
78+
| [VLLM 0.13.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.28.0/vllm/inference/0.13.0/Dockerfile.neuronx) | vllm-neuronx, libneuronxla, neuronx_distributed, neuronx_distributed_inference, torch-neuronx, aws-neuronx-tools, nki | Neuron 2.28.0 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-inference-vllm-neuronx:0.13.0-neuronx-py312-sdk2.28.0-ubuntu24.04 |
7579
| [VLLM 0.13.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.27.1/vllm/inference/0.13.0/Dockerfile.neuronx) | vllm-neuronx, libneuronxla, neuronx_distributed, neuronx_distributed_inference, torch-neuronx, aws-neuronx-tools, nki | Neuron 2.27.1 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-inference-vllm-neuronx:0.13.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
7680
| [VLLM 0.11.0](https://github.com/aws-neuron/deep-learning-containers/blob/2.27.1/vllm/inference/0.11.0/Dockerfile.neuronx) | vllm-neuronx, libneuronxla, neuronx_distributed, neuronx_distributed_inference, torch-neuronx, aws-neuronx-tools | Neuron 2.27.1 | trn1,trn2,trn3,inf2 | 3.12 (py312) | public.ecr.aws/neuron/pytorch-inference-vllm-neuronx:0.11.0-neuronx-py312-sdk2.27.1-ubuntu24.04 |
7781
| [VLLM 0.9](https://github.com/aws-neuron/deep-learning-containers/blob/2.26.1/vllm/inference/0.9.1/Dockerfile.neuronx) | vllm-neuronx, libneuronxla, neuronx_distributed, neuronx_distributed_inference, torch-neuronx, aws-neuronx-tools | Neuron 2.26.1 | trn1,trn2,inf2 | 3.11 (py311) | public.ecr.aws/neuron/pytorch-inference-vllm-neuronx:0.9.1-neuronx-py311-sdk2.26.1-ubuntu22.04 |

0 commit comments

Comments
 (0)