






















Abstract:In Bayesian optimization, Thompson sampling selects the evaluation point by sampling from the posterior distribution over the objective function maximizer. Because this sampling problem is intractable for Gaussian process (GP) surrogates, the posterior distribution is typically restricted to fixed discretizations (i.e., candidate points) that become exponentially sparse as dimensionality increases. While previous works aim to increase candidate point density through scalable GP approximations, our orthogonal approach increases density by adaptively reducing the search space during sampling. Specifically, we introduce Adaptive Candidate Thompson Sampling (ACTS), which generates candidate points in subspaces guided by the gradient of a surrogate model sample. ACTS is a simple drop-in replacement for existing TS methods -- including those that use trust regions or other local approximations -- producing better samples of maxima and improved optimization across synthetic and real-world benchmarks.
| Comments: | AISTATS 2026 |
| Subjects: | Machine Learning (cs.LG) |
| ACM classes: | I.2.6; G.1.6 |
| Cite as: | arXiv:2604.08891 [cs.LG] |
| (or arXiv:2604.08891v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2604.08891 arXiv-issued DOI via DataCite |
From: Donney Fan [view email]
[v1]
Fri, 10 Apr 2026 02:54:31 UTC (6,163 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。