Stemma: Induced Decision Regions Reveal LLM Provenance
This paper introduces Stemma, a black-box LLM fingerprinting method that abstracts away surface-form variation and measures the inheritance of decision regions for reliable provenance testing.
Abstracting away surface-form variation and measuring decision region inheritance for reliable LLM provenance testing
Before reading this…
Applications
- →LLM provenance testing
- →Model comparison
To understand this paper, make sure you know these concepts first:
- Understanding of large language modelsfind papers →
- Background in machine learning and data miningfind papers →
Abstract
More Like ThisLLM provenance testing asks whether a suspect LLM belongs to the same lineage as a source. Existing black-box methods largely infer this relationship from response-level characteristics, but these characteristics may shift under adaptation or deployment even when the underlying meaning remains unchanged, weakening the reliability of provenance evidence. To address this limitation, we introduce induced decision regions by mapping open-ended outputs into a finite decision space, thereby abstracting away surface-form variation and reframing provenance testing as measuring the inheritance of decision regions. Empirical analysis shows that the source's induced regions are preserved more strongly in related models than in unrelated models. Building on this signal, we propose Stemma, a practical black-box LLM fingerprinting method that operationalises stability, robustness, and specificity as complementary probe-selection principles for reliably estimating induced decision region inheritance. Across 770 source-suspect pairs drawn from 56 public checkpoints and spanning diverse model-weight transformations, Stemma achieves 0.967 AUC and 87.8% TPR at 1% FPR, substantially outperforming four representative baselines. It further achieves 0.995 AUC and 93.5% TPR at 1% FPR on 1,260 pairs covering 91 deployment instances, demonstrating robustness to diverse inference-time deployment settings.