Get the latest tech news

DeepX claims inference up to 100B parameters at less than 5 W


None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of inference

inference

Photo of 100B

100B

Photo of parameters

parameters

Related news:

News photo

A primer on key AI LLM concepts — KV cache, weights, quantization, and how inference actually works

News photo

Huawei Ascend 960 SuperPoD aims to surpass Nvidia AI hardware in China — 960E with over 4,000 NPUs and an upgraded UnifiedBus Interconnect aims for 10 trillion parameters

News photo

A search-and-inference database from scratch in pure Zig