Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models
Proposes inference scaling laws showing smaller models with advanced strategies outperform larger ones under limited compute, achieving Pareto optimality.
Yangzhen Wu, Zhiqing Sun, Shanda Li et al.