Get the latest tech news
The Mind-Blowing Experience of a Chatbot That Answers Instantly
AI chips from startup Groq allow chatbots to answer queries almost instantly. That could open up whole new use cases for generative AI helpers.
This is usually an annoying ploy in an interview, but since Groq is super fast I tolerated it, listening as the model explained that graphics chips like Nvidia’s, which work in parallel, are ideal for delivering images. He also noted that the conversation he just had with his creation was so fast that he and the chatbot were almost overlapping, even though he was in Brussels at the moment and the Groq Language Processing Unit (LPU) chips running the model—792 of them, all interconnected—were in Washington state. Hölzle would cite Google’s experience when the company boosted the performance of its Picasa web-based photo service, making slideshows run three times as fast.
Or read this on Wired
