Title: Conformal Mirror Statistics for Model Alignment: Uncertainty Quantification with FDR Control
Primary area: probabilistic methods (Bayesian methods, variational inference, sampling, UQ, etc.)
Keywords: Uncertainty Quantification; Model Alignment; Conformal Inference; False Discovery Rate Control

Abstract: Foundation models are increasingly adopted across diverse domains, but their safe deployment requires outputs that align with human interpretation, especially in high-stakes applications. This motivates the need for rigorous uncertainty quantification (UQ) methods to assess alignment reliability. Most existing methods rely on large labeled datasets, limiting their applicability in real-world settings where labeled data is scarce or expensive. In this paper, we introduce Conformal Mirror Statistics (CMS), a novel framework for UQ in model alignment, selecting aligned outputs for unlabeled data with the false discovery rate (FDR) under control. Unlike conventional conformal methods based on p-value calibration, CMS generalizes to broader settings without restrictive calibration size requirements. 
We further establish theoretical guarantees by proving FDR control under weaker assumptions than prior mirror statistics approaches. 
To improve stability, we introduce an aggregation procedure via multiple data splitting and e-value combination. 
Empirical results on a large sepsis cohort from MIMIC-III demonstrate that CMS consistently outperforms conventional methods while reliably identifying aligned outputs.

TL;DR: We propose Conformal Mirror Statistics, a model alignment method that provides FDR-controlled uncertainty quantification without constraints on labeled dataset size.