Get the latest tech news
Vulkan + Mesa Drivers For AI Inferencing? It's Already Showing Potential On Radeon RADV
Following the Vulkanised 2025 presentation how NVIDIA is finding great success with Vulkan for AI / machine learning and already competitive to CUDA in some areas, Red Hat engineer and DRM subsystem lead maintainer David Airlie began exploring the potential of Mesa Vulkan drivers for AI inferencing
Following the Vulkanised 2025 presentation how NVIDIA is finding great success with Vulkan for AI / machine learning and already competitive to CUDA in some areas, Red Hat engineer and DRM subsystem lead maintainer David Airlie began exploring the potential of Mesa Vulkan drivers for AI inferencing. David Airlie shared a blog post today outlining his experiences exploring the Mesa Vulkan drivers for AI inferencing .At the same time he and others like Karol Herbst of Red Hat are working on addressing feature gaps in the Mesa Vulkan drivers to make then more suitable for handling AI workloads. Airlie's results show that the RADV Vulkan performance with ramalama/llama.cpp for token generation could be faster than using the official AMD ROCm compute stack.
Or read this on Phoronix