Abstract:The practical adoption of sampling-based inference (SAI) in Bayesian neural networks (BNNs) remains limited, partly due to persistent misconceptions about the feasibility and efficiency of sampling. This position paper argues that SAI has achieved computational parity with optimization-based methods and is at the verge of superseding such methods for effective and efficient inference in BNNs. This development should be in the interest of the whole community, promoting BNNs as a principled paradigm with its long-standing yet unfulfilled promise of providing principled uncertainty quantification for neural networks. SAI can even do more -- yielding superior prediction performance through model averaging, serving as the foundation for a plethora of possible downstream tasks, and providing crucial insights into the landscape of BNNs. In order to make such a change happen and unfold the potential of sampling, overcoming current misconceptions is a necessary first step. The next step is to realign research efforts toward addressing remaining challenges in SAI. In particular, the community must focus on two core problems: sufficient exploration of the posterior landscape and high-fidelity distillation of posterior samples for efficient downstream inference. By addressing conceptual and practical obstacles, we can unlock the full potential of SAI and establish it as a central tool in Bayesian deep learning.
| Comments: | In Proceedings of the 43rd International Conference on Machine Learning, PMLR 306, 2026 |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.21765 [cs.LG] |
| (or arXiv:2605.21765v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.21765 arXiv-issued DOI via DataCite (pending registration) |
From: Emanuel Sommer [view email]
[v1]
Wed, 20 May 2026 21:57:21 UTC (131 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。