


















Abstract:A learner does not only fit data; it also determines how strongly the training sample may shape its output and how much distortion it can hedge. We study this relation as a bounded-rational decision problem whose primitive object is the induced channel from samples to outputs. The learner's response law determines which changes in this channel are cheap or costly, and therefore induces both a lower tradeoff curve between training loss and sample dependence and a matched upper certificate curve. When the response law is represented by an $f$-divergence regularizer, these curves live in the regularizer's native information geometry, with KL as the special case corresponding to Shannon mutual information. We show how the hedge and the two curves can be recovered from black-box behavior by observing responses to scaled losses and local loss perturbations. In learning, population loss is empirical loss plus the distortion induced by the particular training sample. The recovered hedge gives a practical certificate when it covers that distortion. Thus generalization is treated as a testable hedging property of the learner's own response law.
| Comments: | 32 pages, 9 figures |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.15340 [cs.LG] |
| (or arXiv:2605.15340v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.15340 arXiv-issued DOI via DataCite (pending registration) |
From: Pedro Alejandro Ortega [view email]
[v1]
Thu, 14 May 2026 19:07:53 UTC (503 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。