Get the latest tech news
Google drops ‘stronger’ and ‘significantly improved’ experimental Gemini models
The Gemini models show "huge gains," with 1.5 Flash across the board and a 1.5 Pro that is much better at math, coding and complex prompts.
Meanwhile, the new Gemini 1.5 Pro shows performance gains on coding and complex prompts and serves as a “drop-in replacement” to its previous model released in early August. Just a few hours after the release today, the Large Model Systems Organization(LMSO) posted a leaderboard update to its chatbot arena based on 20,000 community votes. Another called the updated version “definitely not that good” and said it “often goes crazy and starts repeating stuff non-stop like small models tend to do.” Another agreed that they were excited to try it but that Gemini has “been by far the worst at coding.”
Or read this on Venture Beat