On the Comparison between Multi-modal and Single-modal Contrastive Learning
Proposes a feature learning theory for single- and multi-modal contrastive learning, highlighting signal-to-noise ratio (SNR) as key to generalization.
Wei Huang, Andi Han, Yongqiang Chen et al.