Get the latest tech news
Intel Releases OpenVINO 2024.1 With More Gen AI & LLM Features
Intel engineers have just released OpenVINO 2024.1, the newest feature release for this excellent open-source AI toolkit that continues expanding its features and capabilities particularly around Generative AI 'GenAI' and Large Language Models (LLMs).
Intel engineers have just released OpenVINO 2024.1, the newest feature release for this excellent open-source AI toolkit that continues expanding its features and capabilities particularly around Generative AI "GenAI" and Large Language Models (LLMs). On the generative AI front, OpenVINO 2024.1 adds Mixtral and URLNet models optimized for Intel Xeon CPUs, Stable Diffusion 1.5 / ChatGLM3-6B / Qwen-7B models have been optimized for faster Intel Core Ultra (Meteor Lake) performance with its Arc Graphics, and there is now support added for the Falcon-7B-Instruct LLM. OpenVINO 2024.1 also pulls in the Neural Processing Unit (NPU) plug-in for Intel Core Ultra "Meteor Lake" processors into the GitHub repository rather than having to rely on the external PyPi package.
Or read this on Phoronix
