AI & ML
MIPR: A Benchmark for Reasoning-Intensive Multimodal Intent-to-Product Retrieval with Multi-Category Solutions
arXiv cs.IR0 views
arXiv:2611.22509v1 Announce Type: new Abstract: Real-world e-commerce queries often express user intent without naming a target product, and a single intent may be fulfilled by products from multiple categories. However, existing multimodal retrieval benchmarks typically assume a relatively well-defined target, leaving retrieval for intents with multi-category solutions less explored. To fill this gap, we introduce MIPR, a benchmark for Multimodal Intent-to-Product Retrieval comprising 3,522 multimodal queries and a shared corpus of 30,731 products. MIPR features reasoning-intensive retrieval, multi-category solutions, and fine-grained relevance labels. Experiments show that the best embedding-based retriever achieves 49.23% nDCG@10 on the full query set, and 55.86% solution-category recall@10 on queries with multiple solution categories. Reranking improves these scores to 60.11% and 67.00%, respectively, yet substantial gaps to the candidate-pool oracle remain. These results establish MIPR as a challenging and diagnostic benchmark for evaluating multimodal intent-to-product retrieval. The data and code are publicly available at https://huggingface.co/datasets/leequeue/MIPR.
Source:https://arxiv.org/abs/2611.22509PreviousFrom Relevance to Utility: Rubric Alignment in Yuanbao SearchNextUrban Representation Learning for Identifying Potential Disparities in Crime Reporting
Related posts

Sources: Nvidia made two separate introductions in 2022 connecting Alibaba with alleged Chinese spy Alice Huang, actively helping Megaspeed land Alibaba (The Information)
0Techmeme
Show HN: I cut an LLM's screen-watching cost to ~138 tokens per step
0Hacker News New
Codeberg's Domain Was Suspended
0Hacker News New
Gemini AI agents repeatedly bypassed safeguards to attack real website
0Hacker News New
A new AI agent builder. No-code visual builder with customer support platform
0Hacker News New
Jacob Tsimerman on AI can supercharge mathematics [video]
0Hacker News New