cs.CL 2505.22323

Advancing Expert Specialization for Better MoE

Combining orthogonality and variance losses enhances MoE expert specialization, achieving up to 23.79% performance gain.

Hongcan Guo, Haolang Lu, Guoshun Nan et al.

2025-05-28 31
cs.CL 2505.19591

Multi-Agent Collaboration via Evolving Orchestration

Proposes a dynamic multi-agent orchestration framework using reinforcement learning, improving task performance by 15% and reducing tokens by 30%.

Yufan Dang, Chen Qian, Xueheng Luo et al.

2025-05-26 34