AI & ML
Towards Efficient Whole Page Ranking with One-Pass Inference
arXiv stat.ML0 views
arXiv:2611.05542v1 Announce Type: cross Abstract: Whole-page ranking jointly optimizes advertisements and organic content to balance business outcomes and user engagement under complex layout and business constraints. Existing non-autoregressive (NAR) approaches enable efficient page generation but typically score candidate items independently of previously selected items, limiting their ability to capture order-dependent interactions. Autoregressive (AR) methods address this limitation through sequential conditioning, but incur substantial inference overhead that challenges large-scale deployment. Bridging this quality-efficiency gap remains a challenge in industrial whole-page ranking. We propose Multi-Item Scoring (MIS), a prefix-aware NAR-style framework that incorporates sequential context into efficient multi-item scoring. MIS integrates global candidate interactions, localized prefix conditioning, and position-aware scoring within a shared representation architecture. By computing reusable representations once per request and performing lightweight prefix-conditioned scoring during constrained beam search, MIS captures important sequential dependencies without repeated full-model inference. Experiments on KuaiRand-1K and RL4RS demonstrate that MIS approaches the generation quality of an autoregressive CGA baseline while achieving 4.07x and 3.54x faster CPU decoding, respectively. In a randomized evaluation on a large-scale social-video platform, MIS improves the realization metric by 0.104% and watch time by 0.058%, while reducing ranking-service CPU consumption by 9.73%. These results demonstrate that prefix-aware multi-item scoring can narrow the quality gap between NAR and AR generation while retaining the efficiency required for industrial scalability.
Source:https://arxiv.org/abs/2611.05542PreviousTight Lower Bounds under Matched High-Order H\"older Smoothness and Uniform ConvexityNextSupport Vector Machines Directly Minimise KL Divergence
Related posts

Chain of Recall คืออะไร? Stable IDs ช่วยให้ AI Agent มีความจำได้อย่างไร
0dev.to AI
CMS Migration Without Losing Your Traffic
0dev.to WebDev

Shopify GEO: From Product Data to Checking What AI Actually Cites
0dev.to WebDev
![[Brainstorm] Live Claude Context Debugger – Edit Claude's Context While It's Running](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fkzn32ybtbykj6aul8gxf.png)
[Brainstorm] Live Claude Context Debugger – Edit Claude's Context While It's Running
0dev.to Security
SSH: How It Works and Basic Best Practices
0dev.to Security

Sources: China's export curbs on critical metals have disrupted supplies of micro drill bits made mainly from tungsten carbide, used in PCBs and chip substrates (Cheng Ting-Fang/Nikkei Asia)
0Techmeme