Get the latest tech news

Trinity large: An open 400B sparse MoE model


A deep dive into Trinity Large, covering architecture, sparsity, training at scale, and why we shipped Preview, Base, and TrueBase checkpoints.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of model

model

Photo of Trinity

Trinity

Photo of MoE

MoE

Related news:

News photo

Which Motorola Moto G 2026 model should you buy?

News photo

Humans& thinks coordination is the next frontier for AI, and they’re building a model to prove it

News photo

I camera tested the latest Samsung, Google, and Honor phones in the air - this model won the most