Get the latest tech news

Microsoft Researchers Develop Hyper-Efficient AI Model That Can Run On CPUs


Microsoft has introduced BitNet b1.58 2B4T, the largest-scale 1-bit AI model to date with 2 billion parameters and the ability to run efficiently on CPUs. It's openly available under an MIT license. TechCrunch reports: The Microsoft researchers say that BitNet b1.58 2B4T is the first bitnet with 2 ...

Microsoft has introduced BitNet b1.58 2B4T, the largest-scale 1-bit AI model to date with 2 billion parameters and the ability to run efficiently on CPUs. Trained on a dataset of 4 trillion tokens -- equivalent to about 33 million books, by one estimate -- BitNet b1.58 2B4T outperforms traditional models of similar sizes, the researchers claim. BitNet b1.58 2B4T doesn't sweep the floor with rival 2 billion-parameter models, to be clear, but it seemingly holds its own.

Get the Android app

Or read this on Slashdot

Read more on:

Photo of Microsoft

Microsoft

Photo of cpus

cpus

Photo of efficient AI model

efficient AI model

Related news:

News photo

Microsoft: Office 2016 and Office 2019 reach end of support in October

News photo

Big Tech avoided $278 billion in corporate tax over the past decade, says watchdog | Amazon, Apple, Alphabet, Meta, Microsoft, and Netflix paid just 18.8 percent tax on $2.5 trillion profits

News photo

Microsoft Confirms Classic Outlook CPU Usage Spikes, Offers No Fix