20 results for “Future-oriented coding tasks”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
Qiao Zhao, JianYing Qu, Jun Zhang, Yehua Yang +2 more
The paper proposes SWE-Future, a method for forecasting future coding tasks in software repositories and uses the forecasts to synthesize a dataset for coding-agents.
Arnab Sen Sharma, Eric Todd, Sheridan Feucht, Andy Arditi +6 more
This paper investigates how and if large language models (LLMs) encode goals and how they guide action.
Yuanzhe Liu, Bastian Lipka, Avraham Shinnar, Jatin Ganhotra +2 more
The paper addresses the issue of task under-specification and over-specification in AI benchmarks, proposing techniques for deriving parsimonious hints.
The paper introduces CodeGolf Bench, a novel multi-language benchmark using code golf to measure LLMs' ability to generate highly concise and efficient code, showing that reasoning models significantl…
The paper introduces Clover, a code completion tool that logs students' interactions and offers attention checks to promote reflective engagement during programming tasks.
DeepSWE is a new benchmark for evaluating coding agents with original tasks written from scratch and hand-graded verifiers.
This paper analyzes the efficiency of AI coding agents and identifies the opportunity for reducing unnecessary turns in their loop engineering process.
Yangshen Deng, Jiaqi Ruan, Yeqi Huang, Nick Lau +2 more
The paper introduces InfraDev, a benchmark for evaluating AI infrastructure development, and shows that existing benchmarks are inadequate for assessing real-world tasks.
Peiwen Li, Harshit Verma, Sophia Zhou, Haiwen Wang +5 more
This paper introduces Coding-Repository Memory (CoReMem), a framework that guides memory design and actor adaptation for coding agents.
Xiaoyong Li, Haolong Li, Dongliang Xu, Haoyu Li +6 more
This paper introduces Code Skill Server (CSS), a large-scale search engine for finding useful code generation skills for a target task.
This paper examines the instruction stacks of five coding agents to understand their composition and evolution.
Ningzhi Tang, Chaoran Chen, Gelei Xu, Yiyu Shi +4 more
This study analyzes over 20,000 real-world coding sessions to show that AI coding agents frequently fail users through subtle misalignment, requiring constant manual correction even when major system…
The paper introduces Spine, an interface and runtime that improves the efficiency of long-horizon coding tasks by aligning model context with subtask nesting and completion.
Yangzhen Wu, Aaron J. Li, Wenjie Ma, Li Cao +9 more
BenchEvolver introduces a solution-centric evolutionary framework to automatically transform saturated coding benchmarks into significantly harder, high-quality, and diverse evaluation suites.
This paper investigates various methods for encoding factored tasks, a compact planning representation, into propositional logic for use with SAT solvers, analyzing the impact of encoding choices and…
This paper unifies the fragmented field of Tree-of-Thoughts (ToT) reasoning by mapping LLM-based search processes onto a formal taxonomy derived from classical heuristic search theory.
This paper explores the challenges of building and evaluating AI forecasting systems through a qualitative interview study.
The authors reanimate two historical AI programs, Heuristic Compiler and KBEmacs, to compare their theories of programming and highlight the reflexivity of this project.