Get the latest tech news
Context Is Software, Weights Are Hardware
Both KV cache and weights modulate activations. Context is software running on frozen hardware. Weight updates redesign the hardware itself. The difference matters more than most people think.
None
Or read this on Hacker News
