Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings
Proposes EmbedFilter, a linear transformation that filters the latent subspace encoding high-frequency, uninformative tokens, improving zero-shot text embedding performance by up to 14%.
Songhao Wu, Zhongxin Chen, Yuxuan Liu et al.