SoftBank and AMD Validate GPU Partitioning for AI Workloads Using Instinct GPUs

SoftBank and AMD have started joint validation of AMD Instinct GPUs for next-generation AI infrastructure by focusing on a GPU partitioning mechanism that lets a single GPU handle multiple AI workload

s simultaneously. SoftBank developed an Orchestrator system that divides AMD Instinct GPU resources based on workload requirements: model size, number of concurrent executions, and memory needs. The s ...