Get the latest tech news
AMD Announces Open-Source "GAIA" For GenAI But Currently Windows-Only
AMD on Thursday announced GAIA for 'Generative AI Is Awesome' as a means of easily running local large language models (LLMs) on Ryzen AI PCs with the XDNA NPU
GAIA provides an easy software demonstration for Ryzen AI capabilities but sadly for the moment is limited to Microsoft Windows platforms. GAIA builds atop the ONNX TurnkeyML Lemonade SDK to run models like Llama and Phi. It would be nice to have a nice AMD software demonstration and benchmark for Ryzen AI on Linux now that Linux 6.14 introduces the Ryzen AI "AMDXDNA" accelerator driver and then on the user-space side users are encouraged to go with the IREE plug-in but without any convenient and compelling end-user software that's really easy to immediately deploy for Ryzen AI Linux customers.
Or read this on Phoronix
