Get the latest tech news
Pruna AI open sources its AI model optimization framework
Pruna AI, a European startup that has been working on compression algorithms for AI models, is making its optimization framework open source on Thursday.
In particular, Pruna AI’s framework can evaluate if there’s significant quality loss after compressing a model and the performance gains that you get. “If I were to use a metaphor, we are similar to how Hugging Face standardized transformers and diffusers — how to call them, how to save them, load them, etc. For example, Pruna AI has made a Llama model eight times smaller without too much loss using its compression framework.
Or read this on TechCrunch