Get the latest tech news
Gemini 1.5 is Google’s next-gen AI model — and it’s already almost ready
You’ll be able to ask questions about a movie or all of The Lord of the Rings.
Barely two months after launching Gemini, the large language model Google hopes will bring it to the top of the AI industry, the company is already announcing its successor. It was made using an increasingly common technique known as “Mixture of Experts,” or MoE, which means it only runs part of the overall model when you send in a query, rather than processing the whole thing the whole time. Tokens are a tricky metric to understand ( here’s a good breakdown), so Pichai makes it simpler: “It’s about 10 or 11 hours of video, tens of thousands of lines of code.” The context window means you can ask the AI bot about all of that content at once.
Or read this on The Verge
