Get the latest tech news
Lightning AI launches next-gen AI compiler ‘Thunder’ to accelerate model training
According to Lightning AI, the compiler Thunder achieves up to a 40% speed-up for training LLMs when compared to unoptimized code in real-world scenarios.
According to Lightning AI, the compiler Thunder achieves up to a 40% speed-up for training large language models (LLMs) when compared to unoptimized code in real-world scenarios. Lightning AI CEO and founder William Falcon expressed his excitement to work with Viehmann, noting that “Thomas literally wrote the book on PyTorch. He also noted that combined with Lightning Studios and its profiling tools, customers can use GPUs more effectively and train the LLMs to operate on a faster and larger scale through Thunder’s code optimization.
Or read this on Venture Beat
