Abstract:To address the challenges of obtaining reliable inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via a weighted likelihood based on synthetic data generated from a simpler, more stable model. This method provides a theoretically sound and practically effective alternative to parameter penalization. We establish key theoretical properties of the SRE in generalized linear models, including existence, stability, consistency, and minimax rate optimality. We leverage the Convex Gaussian Min-max Theorem to derive precise asymptotic characterizations in high-dimensional linear regimes where $n/p \to \delta > 0$, both for noninformative synthetic data and for informative auxiliary data in a transfer learning setting. Our asymptotic results characterize how performance depends on the signal strength and the similarity between target and auxiliary data sources. Building upon these results, we develop practical methodologies for high-dimensional inference, including tuning parameter selection, confidence interval construction, and calibrated variable selection. The effectiveness of the SRE is demonstrated through simulation studies and real-data applications.
From: Weihao Li [view email]
[v1]
Fri, 5 Jul 2024 00:40:03 UTC (2,369 KB)
[v2]
Tue, 21 Jan 2025 07:41:54 UTC (2,354 KB)
[v3]
Tue, 11 Feb 2025 09:19:17 UTC (2,075 KB)
[v4]
Mon, 17 Mar 2025 14:33:10 UTC (2,075 KB)
[v5]
Tue, 30 Jun 2026 09:04:37 UTC (1,024 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。