Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines
ReAuSE integrates a built-in autoregressive search engine into a multi-modal LLM, achieving 9.6% improvement on knowledge-based VQA.
Xinwei Long, Zhiyuan Ma, Ermo Hua et al.