IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Executing programs inside transformers with exponentially faster inference

Mixture-of-recursions delivers 2x faster inference—Here’s how to implement it

AMD announces MI350X and MI355X AI GPUs, claims up to 4X generational performance gain, 35X faster inference