Get the latest tech news
Hailo takes on Nvidia with energy-efficient gen AI accelerator for edge devices and $120M in funding
Hailo-10 can run Llama2-7B with up to 10 tokens per second at under 5W of power and produce an image from Stable Diffusion 2.1 in under five seconds.
Even as Nvidia continues to mint money from its massive range of generative AI-focused hardware and software offerings, smaller players competing in the same space are not ready to cave in. Together with the introduction of our Hailo-10 GenAI accelerator, it strategically positions us to bring classic and generative AI to edge devices in ways that will significantly expand the reach and impact of this remarkable new technology,” Hailo co-founder and CEO Orr Danon, said in a statement. “Whether users employ gen AI to automate real-time translation or summarization services, generate software code, or images and videos from text prompts, Hailo-10 lets them do it directly on their PCs or other edge systems, without straining the CPU or draining the battery,” Danon noted.
Or read this on Venture Beat
