Get the latest tech news

Microsoft, Beihang release MoRA, an efficient LLM fine-tuning technique


MoRA is a new LLM fine-tuning technique that solves some of the problems of other parameter-efficient techniques such as LoRA.

Join us in returning to NYC on June 5th to collaborate with executive leaders in exploring comprehensive methods for auditing AI models regarding bias, performance, and ethical compliance across diverse organizations. Join us as we return to NYC on June 5th to engage with top executive leaders, delving into strategies for auditing AI models to ensure fairness, optimal performance, and ethical compliance across diverse organizations. For example, S-LoRA is a framework that enables developers to run thousands of LoRA adapters on a single GPU, unlocking applications that require many fine-tuned LLMs, such as models that are customized based on the content of each user.

Get the Android app

Or read this on Venture Beat

Read more on:

Photo of Microsoft

Microsoft

Photo of MoRA

MoRA

Photo of Beihang release MoRA

Beihang release MoRA

Related news:

News photo

Microsoft should accept and give up Windows 11, throw everything at Windows 12

News photo

Microsoft's Recall preview doesn't need a Copilot+ PC to run

News photo

Microsoft confirms Call of Duty: Black Ops 6 is coming to Xbox Game Pass