Get the latest tech news
768GB of cheap Intel Optane DIMM memory sticks used to run 1-trillion-parameter LLM on a system with a single GPU — local Kimi K2.5 install achieved roughly 4 tokens per second
None
Or read this on r/techGet the latest tech news
None
Or read this on r/techRead more on:
Related news: