Get the latest tech news
Nvidia’s new DGX SuperPOD can handle trillion-parameter AI models
Now what makes the SuperPOD, super is that the DGX SuperPOD can be configured with eight or more DGX GB200 systems and can scale to tens of thousands of GB200 Superchips connected via Nvidia Quantum InfiniBand.
The new DGX SuperPod system is powered by Nvidia’s next generation of GPUs for AI acceleration, known as Blackwell, which is being announced at GTC, as the successor to the Hopper GPU. The system can deliver 240 terabytes of memory, which is critical for large language model (LLM) training and generative AI inference at a massive scale. According to Nvidia, the new version of SHARP delivers 14.4 teraflops of in-network computing, representing a 4x increase in the next-generation DGX SuperPOD architecture compared to the previous generation.
Or read this on Venture Beat