

























Abstract:Domain shift remains a key challenge in deploying machine learning models to the real world. Unsupervised domain adaptation (UDA) aims to address this by minimising domain discrepancy during training, but the discrepancy estimates suffer from high variance in stochastic settings, which can stifle the theoretical benefits of the method. This paper proposes Variance-Reduced Domain Adaptation via Stratified Sampling (VaRDASS), the first specialised stochastic variance reduction technique for UDA. We consider two specific discrepancy measures -- correlation alignment and the maximum mean discrepancy (MMD) -- and derive ad hoc stratification objectives for these terms. We then present expected and worst-case error bounds, and prove that our proposed objective for the MMD is theoretically optimal (i.e., minimises the variance) under certain assumptions. Finally, a practical k-means style optimisation algorithm is introduced and analysed. Experiments on four domain shift datasets demonstrate improved discrepancy estimation accuracy and target domain performance.
| Comments: | Published in TMLR 05/26 |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2512.05226 [cs.LG] |
| (or arXiv:2512.05226v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2512.05226 arXiv-issued DOI via DataCite |
|
| Journal reference: | Transactions on Machine Learning Research, 2835-8856 (2026) |
From: Andrea Napoli [view email]
[v1]
Thu, 4 Dec 2025 20:01:04 UTC (315 KB)
[v2]
Tue, 5 May 2026 18:47:27 UTC (313 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。