Get the latest tech news

Grace Blackwell needs a new scheduler: 27% more usable GPUs from the same racks


NVL72 puts all 72 GPUs in a rack on one NVLink fabric, but only rack-local jobs get the speedup. How SkyPilot keeps multi-node training and inference on NVLink with topology-aware placement, in-place recovery from GPU failures, and automatic defragmentation.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of racks

racks

Photo of Grace Blackwell

Grace Blackwell

Photo of usable GPUs

usable GPUs

Related news:

News photo

IT vendor lists massive $60 million AI supercomputer on eBay with 300 racks of decommissioned GPUs

News photo

Nvidia's Grace Blackwell superchips are officially coming to the PC with RTX Spark notebooks

News photo

Racks of AI chips are too damn heavy | Old data centers physically cannot support rows and rows of GPUs, which is one reason for the massive AI data center buildout.