Get the latest tech news
AMD ZenDNN 5.1 Released For Enhancing AI Inference Performance On EPYC CPUs
Following the AMD ZenDNN 5.0 release from last year's EPYC Turin launch that brought big performance improvements for CPU-based inferencing with this open-source library compatible with Intel's oneDNN, today marks the availability of ZenDNN 5.1 as the next update.
ZenDNN 5.1 is now available for this AMD Zen optimized Deep Neural Network Library for CPU-based AI inferencing. The new ZenDNN release also brings a new kernel for BF16/FP32 matrix multiplication that can lead to better performance with the DIEN model. This AMD library also adds Ahead-Of-Time (AOT) reordering for MATMUL kernels across INT8 / BF16 / FP32 data types.
Or read this on Phoronix