AI & ML
Recommendation Feedback Loops Shape Urban Income Segregation and Venue Visitation
arXiv cs.IR0 views
arXiv:2610.41911v1 Announce Type: new Abstract: Location-based recommender systems shape where people go in cities and learn from the visits they steer, forming a human-AI feedback loop. This feedback loop shapes whom people share places with across income groups and which venues keep attracting customers. Yet platforms judge these systems by their offline accuracy on past visits, a test in which the suggestions never change where people go and which therefore cannot capture long-term effects. Studying these effects in cities is challenging because, unlike online resources, travel constraints and limited venue capacity shape where people can go, while each recommended visit also changes whom other visitors encounter. To capture such features, we build a long-term simulation framework based on fine-grained human mobility data from four U.S. metropolitan areas, with distance and capacity constraints. Focusing on food venues, we study two urban consequences: how unevenly people's exposure is distributed across income groups (experienced income segregation) and the share of venues receiving no visits from simulated residents (venue disappearance). We find that, under every algorithm and in every metropolitan area, at least a fifth of venues stop receiving visits, and that more than half of this loss arises from retraining. More importantly, more accurate algorithms leave people more segregated, and the most accurate algorithm leaves people 15-21% more segregated than they actually are. We then test a re-ranking intervention that favours less popular venues and runs on top of a platform's existing algorithm. It lowers both venue disappearance and segregation across algorithms, largely without directing people to venues where they may feel less comfortable. Our results suggest that impact assessments of recommender systems should account for the feedback loop and report segregation and venue disappearance beyond accuracy.
Source:https://arxiv.org/abs/2610.41911PreviousCompleteness and Cost of Retrieval Structures for Multi-Tool Requests in LLM AgentsNextPrevented is Not Protected: What Attack Success Rate Hides about RAG
Related posts

Anthropic loosens Claude's game cloning ban — AI will now offer to build original games in the requested genre
0Tom's Hardware

SpaceX's plan to build more data center compute than Google's entire lifetime capacity in just 1.5 years is possible, say analysts
0Tom's Hardware
Daily briefing: See a tardigrade shed its skin
0Nature News

Resident Evil director Zach Cregger explains why the iPhone is vital to his work
09to5Mac
He Trolls AI Labs for a Living. Now They All Want to Work With Him
0Wired

Big Tech’s big AI buildout will not end until someone stops it
0The Verge