ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering
Answering visual questions sometimes takes more than looking at an image. ReAG retrieves external knowledge, filters distracting passages, and uses reinforcement learning to improve reasoning over the remaining evidence.
Better answers on Encyclopedic-VQA and InfoSeek, grounded in retrieved knowledge.
* Equal contribution.

