Ai2 releases Olmo-core 3 for trillion-parameter MoE training
Ai2 released Olmo-core 3, the open training stack behind its large mixture-of-experts work. The code adds new parallelism and expert-routing infrastructure, MXFP8 support and checkpoint tooling, and the team reports tests from a 47B-parameter MoE through a 1.2T benchmark plus a short 2.38T capacity run.
Why it matters: Open training systems rarely expose infrastructure intended for trillion-parameter mixtures. The release gives research and infrastructure teams code they can inspect and adapt, while separating claimed systems throughput from evidence of a completed model…