
























Abstract:Existing positional encoding methods in transformers are fundamentally signal-agnostic, deriving positional information solely from sequence indices while ignoring the underlying signal characteristics. This limitation is particularly problematic for time series analysis, where signals exhibit complex, non-stationary dynamics across multiple temporal scales. We introduce Dynamic Wavelet Positional Encoding (DyWPE), a novel signal-aware framework that generates positional embeddings directly from input time series using the Discrete Wavelet Transform (DWT). Comprehensive experiments on ten diverse time series datasets demonstrate that DyWPE consistently outperforms state-of-the-art positional encoding methods, with particularly significant improvements on longer sequences and complex biomedical signals.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2509.14640 [cs.LG] |
| (or arXiv:2509.14640v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2509.14640 arXiv-issued DOI via DataCite |
From: Habib Irani [view email]
[v1]
Thu, 18 Sep 2025 05:37:33 UTC (367 KB)
[v2]
Tue, 5 May 2026 23:09:08 UTC (204 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。