Avraham Shinnar
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
AI×1Software Eng.×1
Frequent co-authors
Research Timeline
2026
Between Spoilers and Guesswork: Avoiding Over-Specification in Coding Benchmarks
The paper addresses the issue of task under-specification and over-specification in AI benchmarks, proposing techniques for deriving parsimonious hints.
Highlighted terms show continued research focus across papers
Papers
cs.AIcs.SEEmpiricalRecentOct 16, 2026
Between Spoilers and Guesswork: Avoiding Over-Specification in Coding Benchmarks
Yuanzhe Liu, Bastian Lipka, Avraham Shinnar, Jatin Ganhotra +2 more
The paper addresses the issue of task under-specification and over-specification in AI benchmarks, proposing techniques for deriving parsimonious hints.
View →