


























Abstract:Although conformal prediction provides robust marginal coverage guarantees, achieving reliable conditional coverage for specific inputs remains challenging. While exact distribution-free conditional coverage is impossible with finite samples, recent work has focused on improving the conditional coverage of standard conformal procedures. Distinct from approaches that target relaxed notions of conditional coverage, we directly target the mean squared error of conditional coverage by refining the quantile regression components that underpin many conformal methods. Leveraging a Taylor expansion, we derive a sharp surrogate objective for quantile regression: a density-weighted pinball loss, where the weights are given by the conditional density of the nonconformity score evaluated at the true quantile. We propose a three-headed quantile network that estimates these weights via finite differences using auxiliary quantile levels at $1-\alpha \pm \delta$, subsequently fine-tuning the central quantile by optimizing the weighted loss. We provide a theoretical analysis with exact non-asymptotic guarantees characterizing the resulting excess risk. Extensive experiments on diverse high-dimensional real-world datasets demonstrate remarkable improvements in conditional coverage performance.
| Comments: | ICML 2026 |
| Subjects: | Machine Learning (cs.LG); Methodology (stat.ME) |
| Cite as: | arXiv:2512.24139 [cs.LG] |
| (or arXiv:2512.24139v5 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2512.24139 arXiv-issued DOI via DataCite |
From: Qianyi Chen [view email]
[v1]
Tue, 30 Dec 2025 11:02:35 UTC (100 KB)
[v2]
Sun, 4 Jan 2026 03:50:59 UTC (100 KB)
[v3]
Fri, 9 Jan 2026 14:51:25 UTC (104 KB)
[v4]
Thu, 5 Feb 2026 16:11:55 UTC (106 KB)
[v5]
Tue, 19 May 2026 15:14:11 UTC (131 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。