Get the latest tech news
LRU is harder to beat than the KV-cache papers suggest
Reproducing agentic KV-cache policy claims on real traces. 68k requests from 393 Claude Code sessions. LRU is harder to beat than the papers suggest. - gauravapiscean/agentic-kv-cache
None
Or read this on Hacker News