Get the latest tech news
Google’s new Gemini model can analyze an hour-long video — but few people can use it
The latest model in Google's Gemini GenAI model family, Gemini 1.5 Pro, has a massive context window -- but it's in private preview.
Google’s characterizing the large-data-input Gemini 1.5 Pro as “experimental,” allowing only developers approved as part of a private preview to pilot it via the company’s GenAI dev tool AI Studio. Models with small context windows tend to “forget” the content of even very recent conversations, leading them to veer off topic — often in problematic ways. (“Tokens” are subdivided bits of raw data, like the syllables “fan,” “tas” and “tic” in the word “fantastic.”) And recently, a group of scientists hailing from Meta, MIT and Carnegie Mellon developed a technique that they say removes the constraint on model context window size altogether.
Or read this on TechCrunch
