An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
Dropout significantly reduces catastrophic forgetting in neural networks, with experimental data showing 15% better retention of old tasks and 20% improved adaptation to new tasks.
Ian J. Goodfellow, Mehdi Mirza, Da Xiao et al.