Search

A supernode is a set of accelerators wired together tightly enough that software treats them as one very large chip rather than a network of separate ones. This approach is often necessary; a model too big to fit on a single card would otherwise have to shovel data across comparatively slow networking, and that overhead can determine whether trillion-parameter models are practical to serve. One of the best examples is Nvidia's GB200 NVL72, which leverages 72 of its Blackwell GPUs in a single configuration, or AMD's 72-GPU Helios configuration, which offers its own Instinct MI455X GPUs with mor