Techly NewsGet the app

Get the latest tech news

Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5


Model: deepseek_r1_distill_llama_8b_q40 Version: 0.12.2 Evaluation Prediction 2 x Raspberry Pi 5 8GB 7.70 tok/s 3.54 tok/s 4 x Raspberry Pi 5 8GB 11.68 tok/s 6.43 tok/s 2 x Raspberry Pi 5 8GB ... šŸ”¶...

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Raspberry Pi

Raspberry Pi

Photo of eval

eval

Photo of tok

tok

Related news:

News photo

Igalia's Optimizations Juicing More Graphics Performance Out Of The Raspberry Pi

News photo

Raspberry Pi Monitor Pairs Great With The Raspberry Pi 500 As A $100 Display

News photo

Build a tiny CA for your homelab with a Raspberry Pi

Some tech leaders think AI could outsmart us and wipe out humanity. Iā€™m a professor of AI ā€“ and Iā€™m not worried »