Intel squeezed a 1.58-bit LLM down to 1.485 bits without changing a single weight
1-Bit LLM in the Browser
Bonsai 27B: A 27B-Class model that runs on a phone
PrismML debuts energy-sipping 1-bit LLM in bid to free AI from the cloud. Bonsai 8B model is competitive with other 8B models but 14x smaller and 5x more energy efficient
PrismML debuts energy-sipping 1-bit LLM in bid to free AI from the cloud