Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier
Aya Expanse combines multi-model data arbitration, preference tuning, and merging, achieving top performance in 8B/32B multilingual models, surpassing state-of-the-art open models.
John Dang, Shivalika Singh, Daniel D'souza et al.