ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

~ similar to 2608.13867· 20 results

cs.SEEmpiricalRecentJun 18, 2026

N-Version Programming with Coding Agents

Javier Ron, Benoit Baudry, Martin Monperrus

This paper revisits N-version programming with AI coding agents and finds substantial common-mode failures but also practical benefits.

View →
cs.SEcs.AIcs.AREmpiricalRecentOct 8, 2026

Closed-loop evaluation of LLM agents for embedded software development

Jorge García-Carrasco, Sergio García-Carrasco, Alejandro Maté, Juan Trujillo

The paper presents a benchmark for evaluating the performance of large language models as embedded coding agents for firmware development.

View →
cs.SEPositionRecentJun 11, 2026

The End of Code Review: Coding Agents Supersede Human Inspection

Martin Monperrus

The authors argue that coding agents can replace traditional human code review in software development.

View →
cs.SEEmpiricalRecentOct 27, 2026

Hidden in Plain Sight: an Empirical Study about The Instruction Stacks of Coding Agents

Felipe de Sant'Anna Paixão, Dhyego Tavares, Eduardo Almeida, Iftekhar Ahmed

This paper examines the instruction stacks of five coding agents to understand their composition and evolution.

View →
cs.AIcs.DCEmpiricalRecentOct 27, 2026

InfraDev: Can Coding Agents Develop AI Infrastructure, and How Can We Tell?

Yangshen Deng, Jiaqi Ruan, Yeqi Huang, Nick Lau +2 more

The paper introduces InfraDev, a benchmark for evaluating AI infrastructure development, and shows that existing benchmarks are inadequate for assessing real-world tasks.

View →
cs.CRcs.AIMay 11, 2026

Engineering Robustness into Personal Agents with the AI Workflow Store

Roxana Geambasu, Mariana Raykova, Pierre Tholoniat, Trishita Tiwari +2 more

The paper argues that current 'on-the-fly' AI agent design lacks necessary software engineering rigor and proposes an 'AI Workflow Store' to provide hardened, reusable, and reliable agent workflows.

View →
cs.SEcs.AIEmpiricalRecentJul 1, 2026

Cheap Code, Costly Judgment: A Case Study on Governable Agentic Software Engineering

James C. Davis, Paschal C. Amusuo, Tanmay Singla, Berk Çakar +1 more

This paper presents a case study on using AI coding agents in software engineering and develops a process model for governing high-velocity agentic implementation.

View →
cs.SEcs.AIEmpiricalRecentOct 12, 2026

When Agent Evaluation Becomes Unreliable: An Empirical Study of Oracle Failures and Configuration-Dependent Measurement in an LLM Agent Benchmark

Junjie Chen

One clear sentence describing what this paper does

View →
cs.SEcs.CRRecentMay 31, 2026

SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces

Qi Hu, Yifeng Tang, Qinghua Wang, Lanyang Zhao +6 more

The paper introduces SABER, a new benchmark that evaluates the operational safety of LLM coding agents in complex, stateful project environments, finding that current models have a high rate of harmfu…

View →
cs.AIRecentMay 31, 2026

"Skill issues'': data-centric optimization of lakehouse agents

Nicole Rose Schneider, Davide Ghilardi, Giacomo Piccinini, Jacopo Tagliabue

The paper introduces a data-centric optimization pipeline to improve coding agents' ability to interact with a branching lakehouse, showing significant accuracy gains by treating agent evaluation as a…

View →
cs.SEcs.AIEmpiricalRecentJun 16, 2026

All Smoke, No Alarm: Oracle Signals in Agent-Authored Test Code

Dipayan Banik, Kowshik Chowdhury, Shazibul Islam Shamim

This paper characterizes oracle signals in test files of agent-authored pull requests and assesses their impact on merge outcomes.

View →
cs.SEcs.AIcs.CLEmpiricalRecentJun 16, 2026

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering

Maria I. Gorinova, Macey Baker, Amy Heineike, Maksim Shaposhnikov +2 more

Coding agents are not just models, but complex systems with multiple components that can have significant impact on benchmark scores

View →
cs.SEcs.AIcs.CLEmpiricalRecentSep 18, 2026

GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions

Xinyu Che, Yunfei Ge, Shihao Li, Yanchen Liu +8 more

This paper introduces GameLogicBench, a benchmark for evaluating the ability of coding agents to implement gameplay rules in game development.

View →
cs.LGcs.AIcs.LOEmpiricalRecentAug 13, 2026

Vero: Can AI Agents Build Formally Verified Software Repositories?

Zhe Ye, Hantao Lou, Yuechun Sun, Peiyang Song +7 more

The paper introduces Vero, the first benchmark for evaluating joint implementation and proof synthesis at the repository level for AI-generated software.

View →
cs.CRcs.AIcs.ETMar 27, 2026

Clawed and Dangerous: Can We Trust Open Agentic Systems?

Shiping Chen, Qin Wang, Guangsheng Yu, Xu Wang +1 more

This paper systematizes the security challenges of open agentic systems, concluding that while attack characterization is mature, the field lacks robust guidelines for operational governance, memory i…

View →
cs.SEcs.LGEmpiricalRecentJul 8, 2026

DeepSWE: Measuring Frontier Coding Agents on Original, Long-Horizon Engineering Tasks

Wenqi Huang, Charley Lee, Leonard Tng, Serena Ge

DeepSWE is a new benchmark for evaluating coding agents with original tasks written from scratch and hand-graded verifiers.

View →