AI & ML
BobFlow: Towards Human-Agent Collaborative Data Science Using Dataflows
arXiv cs.HC0 views
arXiv:2611.05761v1 Announce Type: cross Abstract: Recent advances in large language models (LLMs) have established human-agent collaboration as a promising paradigm for data science. Effective collaboration requires a shared computational abstraction that enables agents to reason about processing logic while allowing human analysts to understand, guide, and refine the analysis. Although scripts written in Python or SQL provide precise control, their syntax and execution details can be difficult for analysts to understand and modify. In this paper, we argue that dataflows are an effective abstraction for human-agent collaboration in data science. We introduce BobFlow, a system that combines the dataflow abstraction with the ReAct paradigm. It enables agents to iteratively construct and execute dataflows for data science tasks while allowing analysts to inspect the analysis and provide feedback. Our user study shows that BobFlow helps analysts understand, inspect, and verify agent-generated analyses. A thorough experimental evaluation across proprietary and open-weight LLMs shows accuracy score gains of up to 18.6 points at just over 1/3 of a script-based ReAct agent's inference cost.
Source:https://arxiv.org/abs/2611.05761PreviousThe Male Abstraction Bias in Internet Culture and Large Language ModelsNextFireOPS: A Human-Centric Emergency Operations Platform
Related posts
Data-Efficient Scaling-Law Discovery for Recommendation Systems via Coupled Hyperparameter Scaling
0arXiv cs.IR
RAGCompass: Generalizable Retriever Routing via Reranking
0arXiv cs.IR
WISE: An Agentic Framework for Whole-page Multimodal Search Experience Attribution
0arXiv cs.IR
Deliberate Latent Reasoning for Sequential Recommendation
0arXiv cs.IR
PMRecBench: A Benchmark for Personalization in Recommendation Agents under Multimodal Queries
0arXiv cs.IR
Generative Retrieval under Real-Time Supply Constraints in Local Commerce
0arXiv cs.IR