





















Abstract:Models that are indistinguishable on in-distribution data can behave very differently under distribution shift. We introduce Perturb-and-Correct (P&C), a post-hoc method for constructing epistemically diverse predictors from a single pretrained network. P&C applies random hidden layer perturbations with a least-squares correction in the subsequent affine layer, producing predictors that agree on calibration data while remaining free to disagree away from it. We analyze this mechanism through the post-correction residual and its first-order sensitivity: the residual is controlled near the calibration distribution by a leverage term, while corrected sensitivity grows as inputs deviate from the calibration geometry. Empirically, P&C achieves a strong ID/OOD tradeoff across MuJoCo dynamics prediction and CIFAR-10 OOD detection, matching or outperforming standard post-hoc baselines while requiring only a single pretrained model. Our findings highlight the potential in further exploiting overparameterization as a strength of deep learning models.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.01632 [cs.LG] |
| (or arXiv:2605.01632v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.01632 arXiv-issued DOI via DataCite (pending registration) |
From: Eleanor Quint [view email]
[v1]
Sat, 2 May 2026 22:48:11 UTC (179 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。