flash attention

AdapTive-LeArning Speculator System (ATLAS): Faster LLM inference

We reverse-engineered Flash Attention 4

Writing Speed-of-Light Flash Attention for 5090 in CUDA C++

Implement Flash Attention Back End in SGLang – Basics and KV Cache