Get the latest tech news
Intel NPU Library v1.2 Adds Int4 Support & Performance Optimizations
Intel released a new version of its NPU Acceleration Library, the user-space Python library for leveraging the Neural Processing Unit (NPU) found within their Core Ultra 'Meteor Lake' laptops and upcoming Lunar Lake and Arrow Lake hardware as well.
In addition to now working with int4 data types, the Intel NPU Library 1.2 offers new backend performance optimizations, Scalar Dot Production Attention (SDPA) NPU kernel support, and persistent compilation handling. About The AuthorMichael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software.
Or read this on Phoronix
