cs.CV 2307.12732

CLIP-KD: An Empirical Study of CLIP Model Distillation

CLIP-KD employs feature alignment and contrastive learning to improve small models, maximizing similarity with teacher features, achieving significant performance gains.

Chuanguang Yang, Zhulin An, Libo Huang et al.

2023-07-24 33
cs.CL 2307.10652

Exploring the Landscape of Natural Language Processing Research

This study constructs a comprehensive taxonomy of NLP research, analyzes over 80,000 papers, and identifies key trends, highlighting language models and responsible AI as future priorities.

Tim Schopf, Karim Arabi, Florian Matthes

2023-07-20 28
physics.optics 2307.08533

Nonlinear Processing with Linear Optics

nPOLO framework employs multiple scattering to realize low-power optical nonlinearities, enabling multi-layer neural network functionalities solely with linear optics.

Mustafa Yildirim, Niyazi Ulas Dinc, Ilker Oguz et al.

2023-07-17 39