The Computational Assessment Stack: An Architecture for AI-Native Measurement
This paper proposes the Computational Assessment Stack (CAS), a four-layer architecture for AI-native measurement in test development.
The paper presents a novel architecture for AI-native measurement in test development, which is different from traditional descriptive prose used to define constructs.
Keywords
Before reading this…
Applications
- →test development
- →artificial intelligence in education
To understand this paper, make sure you know these concepts first:
- psychometric frameworksfind papers →
- artificial intelligencefind papers →
Abstract
More Like ThisTest development is shifting toward automation and agentic artificial intelligence (AI), in which autonomous systems draft items at scale, assemble test forms, administer adaptive assessments, score complex responses, and monitor test quality. As autonomous systems take on more of this work, the architecture underlying test development must change to preserve assessment quality under the new paradigm. This paper proposes the Computational Assessment Stack (CAS), a four-layer architecture for AI-native measurement where every stage of the assessment lifecycle shares a unifying computational construct representation as its base layer. This representation is a machine-readable, modular, and versioned knowledge graph. Three layers are built above it: computational content generation that builds on the knowledge graph; computational psychometrics that derives substantive structure directly from the knowledge graph; an orchestration layer in which agentic systems operationalize the stack under human governance. The paper's core contribution is architectural. Building on foundational psychometric frameworks, the CAS provides a persistent representation that unifies the four layers. Unlike the descriptive prose traditionally used to define constructs in test development, the proposed architecture renders measurement assumptions inspectable and their consequences empirically testable.