Open Source
SciToT: Multimodal Tip-of-the-Tongue Retrieval for Scientific Papers
arXiv cs.IR0 views
arXiv:2611.05829v1 Announce Type: new Abstract: Researchers frequently encounter difficulties re-finding scientific papers when they remember aspects of the content but cannot recall reliable identifiers, such as titles or author names. This type of re-finding task, known as tip-of-the-tongue (ToT) retrieval, is particularly challenging for scientific documents, where recollections may involve textual information and visual elements, including figures, diagrams, and plots. Existing ToT retrieval benchmarks do not address scientific search. We introduce a multimodal benchmark for scientific ToT retrieval, comprising 108,512 open-access scientific documents across five domains and 11,499 synthetically generated queries. To construct the benchmark, we propose a scalable query elicitation pipeline that independently extracts textual and visual memory cues from source documents and uses large language models to generate queries resembling incomplete human recollections. We characterize scientific ToT information needs through an empirical analysis of publicly available re-finding requests and use the outcomes to assess the generated queries using human annotations and automated quality control. The benchmark includes lexical, dense, late-interaction, and visually grounded retrieval baselines. We release the dataset, extracted document representations, generated memory cues, evaluation splits, and accompanying generation and retrieval pipelines under an MIT license to facilitate research on multimodal scientific paper re-finding.
Source:https://arxiv.org/abs/2611.05829PreviousItem Representations Matter: Bridging Hard Semantic IDs and Soft Prototype Mixtures for Generative RetrievalNextWeaver: Weaving Preference Evidence through Incremental Reasoning for Personalized Retrieval-Augmented Generation
Related posts

Your Agents Can't Share a Room. That's the Bug.
0dev.to
Large-scale empirical tuning and comparison of default optimizers for variational inference
0arXiv stat.CO
TOP: Transmission-Oriented Remote Sensing Pansharpening
0arXiv eess.IV
45 System Tables: What an AI-Native Backend Foundation Looks Like
0dev.to Database
Extending the MM-AR Metamodeling Platform with Process Mining Capabilities
0arXiv cs.DB
Data-Driven Likelihood-Ratio Construction for Radar Detection via Bernstein Induction Operators
0arXiv eess.SP