AI & ML
BRIDGE: Bridging the Semantic Quantization Gap for Generative Recommendation
arXiv cs.IR0 views
arXiv:2611.07425v1 Announce Type: new Abstract: Generative recommendation retrieves items by autoregressively generating Semantic IDs(SIDs), where an RQ-VAE quantizes each item into a hierarchical SID sequence that the decoder generates level by level. We identify an overlooked bottleneck in this paradigm: the Semantic Quantization Gap(SQG). Quantization derives SIDs from rich continuous signals, including codebook centroids, local neighborhood geometry, and level-wise entropy. However, the decoder receives only discrete identifiers and loses the semantic structure that shaped them. This mismatch manifests in three ways: a grounding gap, where the decoder lacks semantic anchors when target-side information is limited; a neighborhood gap, where token-level supervision discards inter-item similarity and exacerbates exposure bias; and a difficulty gap, where computation is allocated uniformly despite generation difficulty diminishing with depth. To bridge the SQG, we propose BRIDGE. Codebook-grounded latent reasoning injects frozen quantizer centroids as semantic anchors before SID generation. Privileged EMA self-distillation transfers neighborhood-aware knowledge from a teacher to an on-policy student, preserving inter-item geometry while mitigating exposure bias. Effort-aware recurrence allocates more computation to the challenging early levels and progressively reduces it with depth. Across three Amazon benchmarks, BRIDGE improves Recall@10 and NDCG@10 by 10.9% and 9.7% on average over the strongest baseline (up to 12.6% and 10.7%). In a one-week online A/B experiment on a large-scale e-commerce advertising platform with 5% traffic, BRIDGE improves eCPM by 0.65%.
Source:https://arxiv.org/abs/2611.07425PreviousCacheGraft: Enhancing Retrieval-Augmented Generation via Latent-Space Document EnrichmentNextOptST: Optimizing Semantic Tokenization for LLM-Enhanced Recommendation
Related posts
Layer Rename & Cleanup: batch rename and delete empty layers in Aseprite (free Lite)
0dev.to

Open-Weight LLM vs Hosted API: What Self-Hosting Gives You That an API Can’t
0dev.to
Aizawl to Guwahati Flight Prices: Key Takeaways From a Booking-Window Analysis
0dev.to Data

Thinking Machines Ships Inkling 2 Small While Raising a 5B Round at 40B Valuation
0dev.to News

Ant Group Launches Ling-3.2-flash, a Native Multimodal Model
0dev.to News
OpenAI's $1.25 Trillion Funding Round Falls Short of Its $1.4 Trillion Target
0dev.to News