cs.LG 2601.20985

Distributional Active Inference

Introduces Distributional Active Inference (DAIF), integrating active inference into distributional RL for model-free, efficient control in complex environments.

Abdullah Akgül, Gulcin Baykal, Manuel Haußmann et al.

2026-01-29 55
cs.LG 2601.19897

Self-Distillation Enables Continual Learning

Introduces Self-Distillation Fine-Tuning (SDFT), enabling continual learning with reduced catastrophic forgetting and improved new-task accuracy.

Idan Shenfeld, Mehul Damani, Jonas Hübotter et al.

2026-01-28 32
cs.LG 2601.19895

Post-LayerNorm Is Back: Stable, ExpressivE, and Deep

Keel integrates Highway connections into Post-LayerNorm, enabling stable training of Transformer models over 1000 layers, outperforming Pre-LN in stability and expressivity.

Chen Chen, Lai Wei

2026-01-28 6 citations 30