Get the latest tech news
Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
A storage appliance that shipped before AVX2 existed now runs Google's Gemma 4 26B in my basement, no GPU. Here's how we got a modern MoE model onto a CPU older than the instructions its inference engine assumed were there.
None
Or read this on Hacker News
