Get the latest tech news
TikTok parent company ByteDance releases new open source Seed-OSS-36B model with 512K token context
One of the defining features is its native long-context capability, with a maximum length of 512,000 tokens, 2X OpenAI's GPT-5 family.
The synthetic-data variant, trained with additional instruction data, consistently delivers stronger scores on standard benchmarks and is intended as a higher-performing general-purpose option. The architecture behind Seed-OSS-36B combines familiar design choices such as causal language modeling, grouped query attention, SwiGLU activation, RMSNorm, and RoPE positional encoding. For enterprises comparing open options, these results suggest Seed-OSS offers strong potential across math-heavy, coding, and long-context workloads while still providing flexibility for research use cases.
Or read this on Venture Beat
