
























Abstract:Overparametrized models can exhibit an excellent generalization performance, although they should be prone to overfitting according to classical statistical theory. The discovery of the "double descent", indicating that the generalization error decreases after a certain model complexity has been reached, opened a new line of research. Robust statistics considers statistical estimation on contaminated data, which, due to assumptions that do not hold on real data, let data points appear as outliers w.r.t. the assumed "ideal" distribution, potentially severely distorting any classical estimator. We address the question whether a double descent phenomenon can be observed in a linear regression setting with contaminated training data. We compare the performance of the highly non-robust least-squares interpolation estimator with several robust alternatives. It turns out that large overparametrization indeed allows for a double descent phenomenon, resulting in a very good generalization performance of the least-squares interpolator, surpassing that of the robust alternatives.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.21494 [cs.LG] |
| (or arXiv:2605.21494v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.21494 arXiv-issued DOI via DataCite |
From: Tino Werner [view email]
[v1]
Wed, 15 Apr 2026 16:31:23 UTC (12,637 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。