EVA-CLIP: Improved Training Techniques for CLIP at Scale
EVA-CLIP combines pre-trained EVA, LAMB optimizer, and masking techniques to achieve 82.0% zero-shot ImageNet accuracy with 5.0B parameters, trained on 9B samples.
Quan Sun, Yuxin Fang, Ledell Wu et al.