Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching
DecoR optimizes LLM routing via query decomposition and historical matching, achieving higher accuracy and reduced inference costs.
Bo Lv, Jingbo Sun