Up or Down? Adaptive Rounding for Post-Training Quantization
AdaRound uses Taylor expansion-based adaptive rounding, outperforming nearest neighbor, achieving <1% accuracy loss on 4-bit ResNet without fine-tuning.
Markus Nagel, Rana Ali Amjad, Mart van Baalen et al.