Get the latest tech news
AI2 closes the gap between closed-source and open-source post-training
Ai2 released Tülu 3, a model that makes fine-tuning open-source LLMs easier and get its performance closer to closed LLMs like GPT-4o.
“Our best models result from a complex training process that integrates partial details from proprietary methods with novel techniques and established academic research,” Ai2 said in a blog post. “Our success is rooted in careful data curation, rigorous experimentation, innovative methodologies and improved training infrastructure.” Mixing and matching datasets can make it easier for developers to move from a smaller model to a larger weighted one and keep its post-training settings.
Or read this on Venture Beat