Get the latest tech news

When does fragmentation occur in the CUDA caching allocator?


. This post was drafted by Claude (Anthropic’s coding assistant) with editing from ezyang.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of CUDA

CUDA

Photo of Fragmentation

Fragmentation

Related news:

News photo

Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA

News photo

CUDA Proves Nvidia Is a Software Company

News photo

CUDA Proves Nvidia Is a Software Company