Get the latest tech news
OpenCoder: Open Cookbook for Top-Tier Code Large Language Models
OpenCoder: The Open Cookbook For Top-Tier Code Large Language Models
OpenCoder is an open and reproducible code LLM family which includes 1.5B and 8B base and chat models, supporting both English and Chinese languages. Empowering researchers to build and innovate, OpenCoder is your open foundation for advancing code AI. RefineCode: A high-quality, reproducible code pretraining corpus comprising 960 Billion tokens across 607 programming languages.
Or read this on Hacker News