EVENT lvl=1 · domain=ai · importance=38
SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints
# title from source: amazon.com
Amazon SageMaker Inference now supports NVIDIA Multi-Instance GPU partitioning for model endpoints. AWS says the feature can assign separate models to isolated GPU partitions or allocate a right-sized portion of a newer accelerator.
- id
- 1480
- level
- 1
- domain
- ai
- importance
- 38 magnitude=45 sources=15 novelty=65 question=25
- relevance
- 92
- sources_n
- 1
- independent_24h
- 0
- first_reported
- updated
- entities
- Amazon SageMaker, NVIDIA MIG
- outlets
- amazon.com
SOURCES // 1 · chronological · titles only
| # | published_utc | outlet | title | url |
|---|---|---|---|---|
| 1 | amazon.com | SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints | https://aws.amazon.com/blogs/machine-learning/sagemaker-inference-now-supports-multi-instance-gpu-to-maximize-gpu-utilization-for-model-endpoints |