General
Measuring the collaboration, not the agent
arXiv cs.HC0 views
arXiv:2611.06487v1 Announce Type: new Abstract: Benchmarks for visualization agents score the agent alone; the human only supplies reference answers. For high-dimensional data this misses what matters: the knowledge of which variables count is held by on-site experts, not by the model, so the useful question is how well an analyst and an agent do together. We study one specific form of collaboration, the agent proposes a view, the analyst accepts, rejects, or modifies it, and those judgments are kept for later sessions, and propose five measures for it: complementarity, intervention efficiency, appropriate reliance, knowledge retention, and agency. The first four are computed from interaction logs alone. We test the measures, not people: in a testbed for parallel-coordinates design on public manufacturing data (UCI SECOM), with a simulated analyst whose behavior we control, all four are computable and respond to the controlled differences. Whether they reveal anything about real analysts is the next step; we release the testbed for it.
Source:https://arxiv.org/abs/2611.06487PreviousToday's Work, Tomorrow's Workforce: Incentivizing Learning in AI-Assisted WorkNextPerceived Trust and Transparency in AI-Altered vs. Human-Written LinkedIn Posts
Related posts
Joint Association and Beamforming Design for Cooperative ISAC Systems
0arXiv eess.SP
Ambiguity Elimination via Successive Estimation in ISAC Systems with Reference Signals
0arXiv eess.SP
Community detection with the Bethe-Hessian
0arXiv stat.TH
Exact Transport-Information Correspondence for Distribution-Adaptive Discretization
0arXiv math.IT
Model Predictive Control of Heating Systems via Koopman-Operator Bilinearization
0arXiv eess.SY
3D Pose Estimation in Projection Space via Pixel-level Visible Light Communication
0arXiv cs.RO