Get the latest tech news

OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show


Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.

None

Get the Android app

Or read this on TechCrunch

Read more on:

Photo of OpenAI

OpenAI

Photo of scale

scale

Photo of benchmarks

benchmarks

Related news:

News photo

OpenAI's upcoming Jalapeño chip looks like it'll be an inference beast

News photo

OpenAI says its Jalapeño chip can power faster AI responses than the competition

News photo

OpenAI Claims Its New Chips Can Outperform Nvidia Processors in Tests