A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
Proposes TIPEX, combining replica and structural parallelism, achieving up to 57% accuracy and 40% latency reduction in multi-agent LLM inference.
Zihan Xu, Haolin Tian, Hai Jiang