ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “Task exchangeability”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

stat.MEcs.AIcs.LGEmpiricalRecentJun 11, 2026

Valid Inference with Synthetic Data via Task Exchangeability

Lezhi Tan, Tijana Zrnic

This paper proposes statistical principles for using synthetic data in scientific research with provable validity guarantees.

View →
cs.AIRecentMay 27, 2026

A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks

Tomer Keren, Nitay Calderon, Asaf Yehudai, Yotam Perlitz +2 more

The paper introduces TASTE, an automatic task synthesis method that generates challenging agent benchmarks by evolving tool sequences, demonstrating that existing benchmarks are saturated and that TAS…

View →
cs.AIRecentMay 27, 2026

AsyncTool: Evaluating the Asynchronous Function Calling Capability under Multi-Task Scenarios

Kou Shi, Ziao Zhang, Shiting Huang, Avery Nie +6 more

The paper introduces AsyncTool, a new benchmark designed to evaluate LLM agents' ability to handle multiple, concurrent tasks with delayed tool feedback, demonstrating that asynchronous coordination i…

View →
cs.HCEmpiricalRecentOct 19, 2026

From Tasks to Turns: Measuring Human Labor Contributions in Human-Agent Joint Production

Likai Wang, Dezhao Su, Jing Hu, Yunyun Wan +2 more

A framework for measuring human contributions in human-agent joint production is proposed.

View →
cs.AIEmpiricalRecentJul 26, 2026

E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarios

Weihuang Zheng, Tianyuan Zou, Eileen Ye, Alphet Liu +4 more

The paper introduces E-Bench, a synthetic benchmark for evaluating multi-step tool use in Large Language Models across three product domains.

View →
cs.HCcs.AIcs.SEEmpiricalRecentOct 24, 2026

FlashScript: Compiling Recurring Agent Workflows into Reusable Neuro-Symbolic Programs

Sadra Sabouri, Hosein Hasanbeig, Adam Sage, Shreya Sinha +5 more

The paper presents a method to compile agent runs into reusable neuro-symbolic programs (NSPs) to improve efficiency and consistency.

View →
cs.AIRecentMay 28, 2026

Croissant Tasks: A Metadata Format for Reproducible Machine Learning Evaluations

Omar Benjelloun, Leonardo Martins Bianco, Isabelle Guyon, Thanh Gia Hieu Khuong +7 more

The paper introduces Croissant Tasks, a declarative metadata format designed to achieve conceptual reproducibility in machine learning by abstracting problem specifications from brittle implementation…

View →
cs.ROcs.MAEmpiricalRecentOct 20, 2026

Robot-Task Suitability in Heterogeneous Multi-Robot Task Allocation

Daniel Weiner, Raj Korpan

This paper compares ten deterministic and two LLM-based methods for estimating robot suitability for tasks.

View →
cs.CLcs.SEEmpiricalRecentJun 24, 2026

Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability

Yang Tian, Zhengpeng Shi, Bo Zhao

ToolBench-X is a benchmark for evaluating agents under recoverable reliability hazards

View →
cs.CCcs.DSTheoreticalRecentOct 26, 2026

The Complexity of Value Optimization in Sporadic Task Systems

Christopher Harbourne, Nathan Fisher, Kecheng Yang, Pontus Ekberg +2 more

This paper studies the complexity of Value-based Task Selection (VTS) in real-time systems.

View →
cs.SEcs.AIcs.CLTheoreticalRecentJun 22, 2026

From Task-Guided Conversational Graphs to Goal-Oriented Dialogue Runtimes

Mariano Garralda-Barrio

This paper introduces the Goal-Oriented Dialogue Runtime (GODR), a framework-neutral design pattern for managing complex, multi-domain, interruptible conversations with multiple interdependent objecti…

View →
cs.LGcs.AIcs.CRMay 12, 2026

No More, No Less: Task Alignment in Terminal Agents

Sina Mavali, David Pape, Jonathan Evertz, Samira Abedini +4 more

The paper introduces the Task Alignment Benchmark (TAB) to evaluate terminal agents' ability to selectively follow relevant environmental instructions while ignoring misleading distractors, revealing…

View →
cs.SEcs.AIEmpiricalRecentOct 11, 2026

A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution

Alan Wu, Wei Tao, Yiwen Guo

This paper develops a framework to improve the usability of desktop applications for large language model agents.

View →
cs.LGcs.CLEmpiricalRecentJun 10, 2026

Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks

Mengyu Zheng, Kai Han, Boxun Li, Haiyang Xu +12 more

The paper introduces Claw-SWE-Bench, a benchmark and adapter protocol for evaluating heterogeneous agent harnesses in software engineering tasks.

View →
cs.HCcs.AIcs.SEEmpiricalRecentJun 29, 2026

To Tab or Not to Tab: Measuring Critical Engagement in AI Code Completion Tools Using Behavioral Signals and Attention Checks

Jessica Hutchison, Ian Tyler Applebaum, Kenneth Angelikas, Kush Rakesh Patel +5 more

The paper introduces Clover, a code completion tool that logs students' interactions and offers attention checks to promote reflective engagement during programming tasks.

View →
cs.SEEmpiricalRecentJul 8, 2026

Rethinking Code Performance Benchmarks for LLMs

Nhat Minh Le, Yisen Xu, Zhijie Wang, Tse-Hsun +1 more

This paper evaluates the performance of large language models on popular benchmarks and finds that only a small percentage of the performant implementations are significantly faster than canonical sol…

View →
cs.SEcs.AIEmpiricalRecentOct 27, 2026

Spine: Compiling Subtask Trees into Structured Context for Long-Horizon Coding Agents

Jiahong Xiang, Kunqiu Chen, Lingming Zhang, Yuqun Zhang

The paper introduces Spine, an interface and runtime that improves the efficiency of long-horizon coding tasks by aligning model context with subtask nesting and completion.

View →