Get the latest tech news
Matrix multiplication breakthrough could lead to faster, more efficient AI models
At the heart of AI, matrix math has just seen its biggest boost "in more than a decade.”
In October 2022, we covered a new technique discovered by a Google DeepMind AI model called AlphaTensor, focusing on practical algorithmic improvements for specific matrix sizes, such as 4x4 matrices. However, the new technique, which improves upon the " laser method" introduced by Volker Strassen in 1986, has reduced the upper bound of the exponent (denoted as the aforementioned ω), bringing it closer to the ideal value of 2, which represents the theoretical minimum number of operations needed. Advertisement While the reduction of the omega constant might appear minor at first glance—reducing the 2020 record value by 0.0013076—the cumulative work of Duan, Zhou, and Williams represents the most substantial progress in the field observed since 2010.
Or read this on r/technology