Get the latest tech news
This new Snapdragon chipset supports 220 tokens per second - here's why that's a big deal
At Snapdragon Summit, the company quietly disclosed one of the most impressive stats.
In a conversation with Durga Malladi, SVP and GM of technology planning, edge solutions, and data center at Qualcomm, he told me that the Snapdragon 8 Elite Gen 5 supports up to 220 tokens per second when using a 3B parameter small language model. These stats make the Snapdragon 8 Elite Gen 5 the fastest mobile SoC for running reasoning models on-device, compared to other published numbers. Disclosure: The cost of Sabrina Ortiz's travel to Maui, Hawaii, for the Snapdragon Summit was covered by Qualcomm, a common industry practice for long-distance trips.
Or read this on ZDNet
