General
Measuring the collaboration, not the agent
arXiv cs.HC0 views
arXiv:2611.06487v1 Announce Type: new Abstract: Benchmarks for visualization agents score the agent alone; the human only supplies reference answers. For high-dimensional data this misses what matters: the knowledge of which variables count is held by on-site experts, not by the model, so the useful question is how well an analyst and an agent do together. We study one specific form of collaboration, the agent proposes a view, the analyst accepts, rejects, or modifies it, and those judgments are kept for later sessions, and propose five measures for it: complementarity, intervention efficiency, appropriate reliance, knowledge retention, and agency. The first four are computed from interaction logs alone. We test the measures, not people: in a testbed for parallel-coordinates design on public manufacturing data (UCI SECOM), with a simulated analyst whose behavior we control, all four are computable and respond to the controlled differences. Whether they reveal anything about real analysts is the next step; we release the testbed for it.
Source:https://arxiv.org/abs/2611.06487PreviousToday's Work, Tomorrow's Workforce: Incentivizing Learning in AI-Assisted WorkNextPerceived Trust and Transparency in AI-Altered vs. Human-Written LinkedIn Posts
Related posts
Exact Transport-Information Correspondence for Distribution-Adaptive Discretization
0arXiv math.IT
Model Predictive Control of Heating Systems via Koopman-Operator Bilinearization
0arXiv eess.SY
3D Pose Estimation in Projection Space via Pixel-level Visible Light Communication
0arXiv cs.RO
How software engineering is changing: a tale of two eras
0Hacker News New
Altera Announces Agilex 2X, a Complete FPGA and SoC Portfolio
0Hacker News New
Omarchy 4.5 floats, speaks 50 languages, and runs on your Mac
0Hacker News New