Abstract:Loss functions define estimator optimality, yet current decision-theoretic tools say little about when different losses demand incompatible optimal procedures. This paper introduces a general framework for such incompatibilities using exclusivity regions, classes, and partitions of loss spaces relative to an abstract optimality operator. These partitions decompose a loss family into regimes such that no single estimator can be optimal across distinct regimes. We develop their basic structure, including links to conic geometry and invariance under positive scaling. The framework is formalized for quantile losses, convex margin-based classification losses, and the Huber robust-regression family on skewed models. Together with collapse results, the theory becomes a calculus of loss-design relevance: it identifies which features of a loss can affect the optimal estimator and which cannot. It yields no-free-lunch results for distinct quantile levels, robustness thresholds, and margin invariants, while also showing irrelevance results such as the fact that all classification-calibrated convex surrogates induce the same Bayes classifier. Applications include robust regression, logistic losses, elicitation theory, and model-robust loss partitions.
From: Stanisław Halkiewicz [view email]
[v1]
Wed, 16 Jul 2025 17:37:35 UTC (77 KB)
[v2]
Fri, 8 Aug 2025 13:04:32 UTC (81 KB)
[v3]
Mon, 15 Dec 2025 23:17:21 UTC (68 KB)
[v4]
Thu, 9 Jul 2026 19:10:10 UTC (65 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。