Get the latest tech news

Microsoft researchers developed a hyper-efficient AI model that can run on CPUs


Microsoft researchers have developed — and released — a hyper-efficient AI model that can run on CPUs, including Apple's M2.

Microsoft researchers claim they’ve developed the largest-scale 1-bit AI model, also known as a “bitnet,” to date. BitNet b1.58 2B4T doesn’t sweep the floor with rival 2 billion-parameter models, to be clear, but it seemingly holds its own. Perhaps more impressively, BitNet b1.58 2B4T is speedier than other models of its size — in some cases, twice the speed — while using a fraction of the memory.

Get the Android app

Or read this on TechCrunch

Read more on:

Photo of Microsoft

Microsoft

Photo of cpus

cpus

Photo of efficient AI model

efficient AI model

Related news:

News photo

Inside Muse, Microsoft's gen-AI game tool everyone hates - what's really going on and why is it being marketed at Xbox fans?

News photo

Microsoft warns of blue screen crashes caused by April updates

News photo

Microsoft hits Ctrl-Z after Teams trips over file sharing