In-Context Learning of Linear Systems: Generalization Theory and Applications to Operator Learning
This paper establishes theoretical guarantees for in-context learning of linear systems using linear transformers, introducing task diversity as a key condition for out-of-domain generalization.
Frank Cole, Yulong Lu, Wuzhe Xu et al.