Two Conformal Constructions for Adaptive Within-Document AI-Text Screening
The paper presents two finite-sample constructions for controlling false alerts when screening text generated by AI.
The paper presents two novel constructions for controlling false alerts when screening text generated by AI, which is not addressed in prior work.
Before reading this…
Applications
- →AI applications
- →text screening
To understand this paper, make sure you know these concepts first:
- conformal ranksfind papers →
- false-alert budgetfind papers →
Abstract
More Like ThisWe study false-alert control when screening for text generated by artificial intelligence (AI). The screening procedure selects document prefixes and detectors from observed evidence and may stop before exhausting its inspection budget. We give two finite-sample constructions under document-level exchangeability between human calibration documents and a new null document, with no restriction on dependence among tokens within a document. Construction A registers a finite family of prefix-detector scores and allocates a false-alert budget across their conformal ranks. A union bound protects any executed subset of that family. Construction B calibrates the complete-path maximum of a development-fixed adaptive policy. Each partial-path maximum is bounded by the complete maximum, so a terminal conformal rank protects early stopping without splitting the error budget. We prove marginal control of any false alert across the permitted inspection path and derive necessary calibration counts for rejection. We also state oracle testing, distribution-shift, and independent-audit bounds with their additional assumptions. Both constructions protect stopping within their specified scope; neither proof constructs an e-process or justifies multiplying conformal ranks. Detection power and computational savings remain questions for empirical evaluation.