cs.CV 2605.31503

How can embedding models bind concepts?

Study finds CLIP's concept binding is complex; new models use multiplicative interactions for low-complexity binding.

Arnas Uselis, Darina Koishigarina, Seong Joon Oh

2026-05-30 3
cs.CL 2605.31490

Are Full Rollouts Necessary for On-Policy Distillation?

Proposed horizon-control strategies—Progressive OPD and Truncated OPD—significantly improve long-horizon on-policy distillation efficiency, achieving 3× faster training and comparable performance with only 10% rollout length.

Yaocheng Zhang, Jiajun Chai, Yuqian Fu et al.

2026-05-30 54
cs.LG 2605.31215

Fixed-Point Masked Generative Modeling

Introducing Fixed-Point Masked Generative Models (FP-MGMs), which use shared attention layers with a fixed-point solver for adaptive depth, reducing parameters by 38.8% and training time by 11.5%.

Andrea Miele, Yiming Qin, Alba Carballo-Castro et al.

2026-05-29 54