AI & ML
AutoAnalysis: An automated, self-updating meta-analysis of human-AI collaboration
arXiv cs.HC0 views
arXiv:2610.42001v1 Announce Type: new Abstract: As generative artificial intelligence (AI) becomes more capable and widely used, understanding when and how humans should work with these systems is becoming increasingly important. However, the empirical evidence in this space offers conflicting recommendations, which leaves individuals and organizations without clear guidance on when to combine human and AI capabilities. Existing meta-analyses can help reconcile these findings, but they require substantial manual effort and cannot readily incorporate new evidence as it emerges. To address this challenge, we introduce AutoAnalysis: an automated, self-updating meta-analysis of when humans and AI work better together, and when they work better alone. AutoAnalysis' most recent run synthesizes 1,955 effect sizes from 420 papers. Across this body of work, we found that, on average, human-AI combinations performed significantly better than humans alone, but they performed significantly worse than the better of humans or AI alone. These findings highlight the important distinction between improving human performance and achieving human-AI synergy and underscore the need to evaluate collaboration against both human and AI performance alone. As new studies emerge, AutoAnalysis will integrate their findings into the meta-analysis, providing cumulative evidence about when humans and AI perform better together and how human-AI performance varies across AI agents, tasks, and processes.
Source:https://arxiv.org/abs/2610.42001PreviousMERIDIAN: Memory-Encoded Rituals for Intimacy across Distance in an Interactive, Asynchronous NeighbourhoodNextNedimo: An Evidence-Grounded Multilingual Pipeline for AI-Generated Sleep Stories
Related posts
Is semantic chunking actually better than rule-based splitting for RAG retrieval?
0dev.to
Firefox RSS Reader: Get News Headlines on Your New Tab Without a Subscription
0dev.to

A slow WordPress admin: capture one request before changing plugins
0dev.to
Proton CEO dismisses AI security-test request as 'bullshit and loser thinking'
0Hacker News New
Musk and Gwynne Shotwell on AI Risks, Peer Review, Starship, Terafab, Merger
0Hacker News New
Anthropic sends out, then retracts details of IPO filing, emails show
0Hacker News New