Get the latest tech news

768GB of cheap Intel Optane DIMM memory sticks used to run 1-trillion-parameter LLM on a system with a single GPU — local Kimi K2.5 install achieved roughly 4 tokens per second


None

Get the Android app

Or read this on r/tech

Read more on:

Photo of Intel

Intel

Photo of System

System

Photo of LLM

LLM

Related news:

News photo

Intel's Latest Round Of Open-Source Projects Ended: OBS Studio Plugin, CVE Binary Tool & More

News photo

KDE Plasma 6.8 To Support System Monitor With Intel Xe, Plasma 6.7 Sees More Crash Fixes

News photo

After a year, Firefox finally stops crashing on Intel's Raptor Lake CPUs — Mozilla releases new version patch critical flaw on Intel 13th-gen and 14th-gen CPUs