Get the latest tech news

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second


A Reddit homelabber’s Optane PMem 200 server now runs Moonshot AI’s Kimi K3 at 3.11 tokens/s with two RTX 3090s and a RAM drive.

None

Get the Android app

Or read this on Tom's Hardware

Read more on:

Photo of RTX

RTX

Photo of tokens

tokens

Photo of Kimi AI

Kimi AI

Related news:

News photo

Get an RTX 5070 for just $839.99, a rare savings in the GPU wasteland

News photo

Three 'e-waste' Nvidia V100s hit 100 tokens per second on Qwen 3.6 35B in a $1,042 homelab rig

News photo

Save $385 on this 4K-ready Alienware gaming PC with an RTX 5080 and 32GB DDR5 right now