Get the latest tech news

Nvidia’s new DGX SuperPOD can handle trillion-parameter AI models


Now what makes the SuperPOD, super is that the DGX SuperPOD can be configured with eight or more DGX GB200 systems and can scale to tens of thousands of GB200 Superchips connected via Nvidia Quantum InfiniBand.

The new DGX SuperPod system is powered by Nvidia’s next generation of GPUs for AI acceleration, known as Blackwell, which is being announced at GTC, as the successor to the Hopper GPU. The system can deliver 240 terabytes of memory, which is critical for large language model (LLM) training and generative AI inference at a massive scale. According to Nvidia, the new version of SHARP delivers 14.4 teraflops of in-network computing, representing a 4x increase in the next-generation DGX SuperPOD architecture compared to the previous generation.

Get the Android app

Or read this on Venture Beat

Read more on:

Photo of Nvidia

Nvidia

Photo of DGX

DGX

Photo of parameter AI models

parameter AI models

Related news:

News photo

Nvidia bringing its Omniverse technology to Apple's Vision Pro headset

News photo

Nvidia enlists humanoid robotics’ biggest names for new AI platform, GR00T

News photo

Nvidia launches NIM to make it smoother to deploy AI models into production