MixtureVitae: Open Web-Scale Pretraining Dataset With High Quality Instruction and Reasoning Data Built from Permissive-First Text Sources
Huu Nguyen*, Victor May*, Harsh Raj*, Marianna Nezhurina, Yishan Wang, ..., Jenia Jitsev
TMLR (Featured / J2C → ICML) 2026