Get the latest tech news
Liquid AI is revolutionizing LLMs to work on edge devices like smartphones with new ‘Hyena Edge’ model
Hyena Edge’s success positions Liquid AI as one of the emerging players to watch in the evolving AI model landscape.
STAR explores a wide range of operator compositions, rooted in the mathematical theory of linear input-varying systems, to optimize for multiple hardware-specific objectives like latency, memory usage, and quality. Hyena Edge was trained on 100 billion tokens and evaluated across standard benchmarks for small language models, including Wikitext, Lambada, PiQA, HellaSwag, Winogrande, ARC-easy, and ARC-challenge. On every benchmark, Hyena Edge either matched or exceeded the performance of the GQA-Transformer++ model, with noticeable improvements in perplexity scores on Wikitext and Lambada, and higher accuracy rates on PiQA, HellaSwag, and Winogrande.
Or read this on Venture Beat
