Get the latest tech news
Two RTX 5090 hosts sharing a KV cache over Ethernet
What a KV cache is, why moving a coding-agent session between GPU hosts is expensive, and how much a faster link helps viiwork's kv_share keep those switches warm — measured on two RTX 5090 hosts.
None
Or read this on Hacker News
