- Amazon ECS adds GPU sharing with NVIDIA MPS, enabling multiple tasks to run concurrently on a single GPU.
- Containers can specify required GPU memory and optional compute share, and ECS schedules tasks onto GPUs with available capacity.
- Supported on both ECS Managed Instances and EC2; ECS monitors the MPS daemon and automatically replaces unhealthy instances.