Invariant Reasoning Directions in Latent Trajectories of Language Models
Introduces TILR, a low-rank subspace method that identifies stable reasoning directions, improving model consistency by ~10% and reducing trajectory variance by 50%.
Arun Vignesh Malarkkan, Manan Roy Choudhury, Utkarsh Byahut et al.