Get the latest tech news
Intel Updates Its PyTorch Build With More Large Language Model Optimizations
Intel has released their Intel Extension for PyTorch v2.3 to succeed their earlier v2.1 derived extension
With this updated extension targeting PyTorch 2.3, Intel is rolling out more optimizations around Large Language Models (LLMs). With the v2.3 extension, there are new Large Language Model optimizations with a new feature called the LLM Optimization API for module-level optimizations to commonly used LLMs, updating the bundled Intel oneDNN neural network library, adding TorchServer CPU examples, other LLM performance optimizations, and improved warnings and logging information. Those making use of PyTorch on Intel platforms can find the updated open-source extension on GitHub.
Or read this on Phoronix