AWS Machine Learning BlogT1·Infra
62 pts
Amazon SageMaker Inference now supports GPU partitioning via NVIDIA Multi-Instance GPU (MIG), splitting a physical GPU into hardware-isolated partitions each with a fixed share of compute and dedicated memory. This removes the whole-accelerator minimum, letting teams host more models per instance or request a fraction of a newer GPU instead of over-provisioning.