Noel Thomas
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper introduces FormInv, a measurement protocol that reveals significant semantic inconsistencies in existing mathematical reasoning benchmarks, showing that standard accuracy metrics fail to capture model reliability.
The paper introduces FormInv, a measurement protocol that reveals significant semantic inconsistencies in existing mathematical reasoning benchmarks, showing that standard accuracy metrics fail to capture model reliability.
Papers
FormInv: A Measurement Protocol for Semantic Invariance in Mathematical Reasoning Benchmarks
The paper introduces FormInv, a measurement protocol that reveals significant semantic inconsistencies in existing mathematical reasoning benchmarks, showing that standard accuracy metrics fail to cap…