AWS / update detail

Amazon SageMaker HyperPod now supports disaggregated prefill and decode

Official AWS changelog summary with source attribution, release tags, and community reactions.

Track this AWS release note alongside related changelog updates, risky changes, and weekly digest signals from the developer community.

AWS·17 hours ago · Jul 6, 2026, 09:29 PMFeatureAI-assisted summary

Summary

Introduces Disaggregated Prefill and Decode (DPD) for SageMaker HyperPod, separating LLM prefill and decode onto dedicated GPU pools via EFA RDMA
Provides consistent per-token latency, higher goodput, and independent scaling of prefill/decode workloads with an intelligent router
Enables DPD via a `pdSpec` in the existing InferenceEndpointConfig, composable with KV cache offloading

official source

Verify the original release note

Every summary should remain traceable to the original changelog or release source.

AI-assisted summarysource healthyLast checked 14 hours ago

related updates

AWS·17 hours agoFeature

Summary

Introduces a self‑service capability to increase or decrease Amazon Cognito provisioned API rate limits on demand via console or new API operations

pricing