Get the latest tech news

Jailbroken PS4 runs 9-billion-parameter AI model at up to 43 tokens per second


Garlic LLM runs Alibaba’s Qwen3.5-9B on a jailbroken PlayStation 4’s GPU, fully offline, at 31 to 39 tokens per second.

None

Get the Android app

Or read this on Tom's Hardware

Read more on:

Photo of tokens

tokens

Photo of jailbroken

jailbroken

Photo of parameter AI model

parameter AI model

Related news:

News photo

Show HN: Log every LLM call with tokens, cost, latency, and time to first token

News photo

Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone

News photo

Chainalysis says hackers stole credentials and tokens for all of its customers