- Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for disaggregated and multi-node inference.
- Enables serving large models across multiple nodes and splitting prefill and decode into independently scalable GPU pools.
- HyperPod manages the underlying distributed serving infrastructure automatically through the Inference Operator add-on.