


























Abstract:Entropic regularized optimal transport (OT) via the Sinkhorn algorithm has become a fundamental tool in machine learning, yet existing implementations either suffer from numerical instability for small regularization parameters or incur significant overhead from deep learning frameworks. We present FastSinkhorn, a lightweight, native CUDA implementation of the log-domain Sinkhorn algorithm that combines warp-level shuffle reductions with shared-memory tiling to achieve high GPU utilization without sacrificing numerical stability. Our solver operates entirely in the log-domain, enabling robust computation for regularization parameters as small as epsilon = 10^{-4} where standard-domain methods fail. On dense OT problems with n = m = 8192, our implementation achieves 12x speedup over the widely-used POT library and 5.9x speedup over GPU-accelerated PyTorch baselines, while consuming only 256 MB of GPU memory. We validate our solver on image color transfer, 3D point cloud matching, and convergence analysis, demonstrating that native CUDA kernels with careful numerical treatment provide a practical and efficient foundation for large-scale optimal transport computation.
| Comments: | 14 pages, 7 figures, code at this https URL |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.00837 [cs.LG] |
| (or arXiv:2605.00837v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.00837 arXiv-issued DOI via DataCite |
From: Hao Xiao [view email]
[v1]
Sat, 4 Apr 2026 16:06:27 UTC (613 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。