Get the latest tech news
Gemini Diffusion
Another of the announcements from Google I/O yesterday was Gemini Diffusion, Google's first LLM to use diffusion (similar to image models like Imagen and Stable Diffusion) in place of transformers. …
Traditional autoregressive language models generate text one word – or token – at a time. Instead of predicting text directly, they learn to generate outputs by refining noise, step-by-step. Prior to this the only commercial grade diffusion model I've encountered is Inception Mercury back in February this year.
Or read this on Hacker News