AI & ML
Pix2Evidence: A Multimodal RAG System for Text and Visual Evidence
arXiv cs.IR0 views
arXiv:2610.41335v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) over visually rich documents must find both relevant content and the evidence that supports an answer. Screenshot retrieval preserves images and page structure, but written facts within screenshots also need to be searchable. Moreover, topical relevance alone does not identify which retrieved tile contains evidence for the answer. We introduce Pix2Evidence, a multimodal RAG system that encodes each screenshot tile together with its available transcription into a single fused image--text representation, so that layout and readable text are considered jointly during retrieval. To guide evidence selection, a vision-language teacher describes the visible content that supports each training question. We use these descriptions to adapt the retriever, then rerank the retrieved candidates before answer generation. Extensive experiments demonstrate that Pix2Evidence outperforms state-of-the-art methods. Across five widely-used Wikipedia QA benchmarks, the non-reranked Pix2Evidence leads the main comparison in answer accuracy on four. On MMSearch, it reaches 26.0\%, 4.4 percentage points above PixelRAG. We will release the code and share derived data where licensing and privacy reviews permit.
Source:https://arxiv.org/abs/2610.41335PreviousMILES-Rec: Uncovering Implicit Intents from Mobility Behaviors for Cross-Domain POI RecommendationNextDefining Page-Centric Visual Document Retrieval and Evaluating Existing Benchmarks
Related posts
Running AI Models Locally in 2026: Ollama, vLLM & Quantization
0dev.to

Most companies don't think they could leave their main cloud provider quickly should the worst happen
0TechRadar

'Nothing will ever replace the emotional depth and creative inspiration of human beings as artists and creators' — Call of Duty: Modern Warfare 4 composer speaks out against AI in video games, says 'm
0TechRadar

Two dead, five injured in Taiwan PCB factory explosion
0Tom's Hardware

HomeView will support third-party AI chatbots, suggests code
09to5Mac

Google’s AI search fumbles leave schools in the lurch
09to5Google