AI & ML
More Than a Score: Reinforcement Learning with Verbalized Feedback for Generative Recommendation
arXiv cs.IR0 views
arXiv:2611.22410v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for generative recommendation, where recommended items are generated directly from users' interaction histories. To further improve recommendation quality, reinforcement learning (RL) has been applied to align these models with recommendation objectives. However, existing RL methods rely on scalar rewards to implicitly guide exploration. These rewards do not specify which aspects of a candidate conflict with the user's preferences or how the next candidate should differ. To address this gap, we propose VerRec, a verbalized feedback-guided RL framework for generative recommendation. Specifically, a user simulator generates personalized verbalized feedback based on the user's historical preferences and the candidate item profile. The policy uses this feedback to produce refined recommendations. Original and refined candidates form an expanded group and are jointly optimized with group relative policy optimization. The user simulator is only required during training and is removed at inference time. Experiments on three Amazon review datasets with two generative recommendation backbones demonstrate that VerRec improves recommendation accuracy and ranking quality. Further analyses show that verbalized guidance encourages exploration of more diverse candidates and helps the policy discover more rewarding recommendations during training.
Source:https://arxiv.org/abs/2611.22410PreviousDeal With It: On Better Schedules for Listwise RerankingNextFrom Relevance to Utility: Rubric Alignment in Yuanbao Search
Related posts

Sources: Nvidia made two separate introductions in 2022 connecting Alibaba with alleged Chinese spy Alice Huang, actively helping Megaspeed land Alibaba (The Information)
0Techmeme
Show HN: I cut an LLM's screen-watching cost to ~138 tokens per step
0Hacker News New
Codeberg's Domain Was Suspended
0Hacker News New
Gemini AI agents repeatedly bypassed safeguards to attack real website
0Hacker News New
A new AI agent builder. No-code visual builder with customer support platform
0Hacker News New
Jacob Tsimerman on AI can supercharge mathematics [video]
0Hacker News New