Get the latest tech news

GPUs can now use PCIe-attached memory or SSDs to boost VRAM capacity


Provided that AMD, Intel, and Nvidia would like to support CXL for memory expansions.

(Image credit: Panmnesia)To address this, Panmnesia developed a CXL 3.1-compliant root complex (RC) equipped with multiple root ports (RPs) that support external memory over PCIe) and a host bridge with a host-managed device memory (HDM) decoder that connects to the GPU's system bus. (Image credit: Panmnesia)The solution (based on a custom GPU and marked as CXL-Opt) underwent extensive testing, showing a two-digit nanosecond round-trip latency (compared to 250ns in the case of prototypes developed by Samsung and Meta, which is marked as CXL-Proto in the graphs below), including the time needed for protocol conversion between standard memory operations and CXL flit transmissions, according to Panmnesia. If the approach of using PCIe-attached memory for GPUs does gather steam, only time will tell if the industry heavyweights will use IP blocks from companies like Panmnesia or simply develop their own tech.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of GPUs

GPUs

Photo of ssds

ssds

Photo of VRAM

VRAM

Related news:

News photo

Intel Unveils Optical Compute Interconnect Chiplet: Adding 4 Tbps Optical Connectivity To CPUs or GPUs

News photo

When are SSDs slow?

News photo

New Transformer architecture could enable powerful LLMs without GPUs