RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Format
RAIN-Merging is a gradient-free method that enhances instruction-following in large reasoning models while preserving their thinking format, with over 8% improvement in benchmarks.
Zhehao Huang, Yuhang Liu, Baijiong Lin et al.