AI & ML
Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News
arXiv cs.HC0 views
arXiv:2604.03755v2 Announce Type: replace-cross Abstract: Can humans tell whether a news article was written by a person or a large language model (LLM)? We investigate this question using JudgeGPT, a study platform that independently measures source attribution (human vs. machine) and authenticity judgment (legitimate vs. fake) on continuous scales. From 2,318 judgments collected from 1,054 participants across content generated by six LLMs, we report five findings: (1) participants cannot reliably distinguish machine-generated from human-written text (p > .05, Welch's t-test); (2) this inability holds across all tested models, including open-weight models with as few as 7B parameters; (3) self-reported domain expertise predicts judgment accuracy (r = .35, p < .001) whereas political orientation does not (r = -.10, n.s.); (4) clustering reveals distinct response strategies ("Skeptics" vs. "Believers"); and (5) accuracy degrades after approximately 30 sequential evaluations due to cognitive fatigue. The answer, in short, is no: humans cannot reliably tell. These results indicate that user-side detection is not a viable defense and motivate system-level countermeasures such as cryptographic content provenance.
Source:https://arxiv.org/abs/2604.03755PreviousEroding the Truth-Default: A Causal Analysis of Human Susceptibility to Foundation Model Hallucinations and Disinformation in the WildNextA Cross-Country Evaluation of Sentiment Toward Digital Payment Systems in Africa
Related posts
![AMR Sensors and Perception — Ch.24: Industrial Perception Case Studies [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F3eo7otf0yw0mo2jejvcp.png)
AMR Sensors and Perception — Ch.24: Industrial Perception Case Studies [KR]
0dev.to
![AMR Sensors and Perception — Ch.25: Future Robot Perception [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fy4fzjnsgx5o5xom1n9ur.png)
AMR Sensors and Perception — Ch.25: Future Robot Perception [KR]
0dev.to
AI投資ROIゼロの現実——ドメイン特化 空間コンピューティングが示す次の実用層:NexoPeekの技術的アプローチ
0dev.to

How to have an AI agent check your competitors' websites every weekday morning
0dev.to
![AMR Sensors and Perception — Ch.18: 3D Perception [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fi3kxzzmrzsvfs689e3le.png)
AMR Sensors and Perception — Ch.18: 3D Perception [KR]
0dev.to
![AMR Sensors and Perception — Ch.19: Obstacle Detection [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F3lffj7uhnhqf595di3cg.png)
AMR Sensors and Perception — Ch.19: Obstacle Detection [KR]
0dev.to