Cluster LOCO: Feature Importance For Interpreting Clusters
This paper proposes a model-agnostic feature importance score for clustering called Cluster LOCO, which measures how much a feature's removal degrades clustering generalizability.
This paper introduces a novel method for measuring feature importance in clustering that is model-agnostic and based on generalizability.
Before reading this…
Applications
- →Market segmentation
- →Biological data analysis
- →Cell-type discovery in single-cell transcriptomics
To understand this paper, make sure you know these concepts first:
- Clustering algorithmsfind papers →
- Feature importance scoresfind papers →
Abstract
More Like ThisClustering is widely used for exploratory analysis and scientific discovery, driving insights from market segmentation to biological data analysis, but its outputs can be difficult to interpret, audit, and reproduce as modern datasets become increasingly large and complex. Reliable use of clustering requires understanding which features drive the discovered structure, yet feature-level explanations for clustering remain scarce compared with methods in supervised learning. Furthermore, existing clustering feature importance scores are often tied to specific algorithms and data assumptions. To address these challenges, we propose Cluster LOCO (Leave-One-Covariate-Out), a family of model-agnostic feature importance scores for clustering. Cluster LOCO is built on feature occlusion and clustering generalizability, defined as whether cluster labels learned on one subset of the data can be accurately predicted on held-out samples. For any chosen clustering algorithm, Cluster LOCO quantifies a feature's importance by measuring how much its removal degrades generalizability. We first introduce Cluster LOCO-Split, which relies on data splitting, and then extend it to Cluster LOCO-MP, a minipatch ensemble-based version designed for large-scale data. Across synthetic simulations and an application to cell-type discovery in single-cell transcriptomics, we show that Cluster LOCO more reliably recovers informative features than existing clustering feature importance methods.