Cerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8B

Cerebras Inference: AI at Instant Speed

Cerebras gives waferscale chips inferencing twist, claims 1,800 token per sec generation rates

Google Cloud Run embraces Nvidia GPUs for serverless AI inference