Sensitivity and Generalization in Neural Networks: an Empirical Study
Using input-output Jacobian norm as a sensitivity metric, the study finds strong correlation with neural network generalization across architectures and datasets.
Roman Novak, Yasaman Bahri, Daniel A. Abolafia et al.