Get the latest tech news

Running local models on an M4 with 24GB memory

Experiments with getting usable outputs out of local models on a standard Macbook

None

Related news:

Running local models on Macs gets faster with Ollama's MLX support | Apple Silicon Macs get a performance boost thanks to better unified memory usage.

Speechify’s Windows app uses local models for transcription and dictation

Fully spec'd Mac Studio with M3 Ultra chip is $14,099 with 512GB memory and 16TB storage

« Guy Goma's Accidental BBC Interview Lives on After 20 Years

Cyber-crime increasingly coming with threats of physical violence »