A Comparative Analysis of Contextual Representation Flow in State-Space and Transformer Architectures
Analyzed representation flow in SSMs and TBMs using centered kernel alignment and variance metrics, revealing layer-wise information flow differences.
Nhat M. Hoang, Do Xuan Long, Cong-Duy Nguyen et al.