Abstract:Speech restoration aims to recover clean speech from degraded recordings affected by noise, reverberation, bandwidth reduction, or other distortions, where input and output sampling rates may differ. Existing approaches typically assume matched input-output rates and apply redundant resampling, limiting native multi-rate processing. We formulate this gap as the extended sampling-frequency-independent (xSFI) setting, where a model must operate under decoupled input-output rates, and propose TF-Restormer, a query-based xSFI modeling framework. The model encodes only the observed input band and synthesizes the unobserved high-frequency band through extension queries with band-partitioned cross-attention, yielding an asymmetric encoder-decoder that allocates capacity to analysis while keeping synthesis lightweight. Trained with a perceptual loss, a scaled log-spectral loss, and adversarial supervision via an SFI-STFT discriminator, TF-Restormer attains balanced fidelity-perceptual quality as a single unified model, without redundant resampling across denoising, dereverberation, bandwidth extension, and combined distortion benchmarks under multiple sampling rates.
From: Ui-Hyeop Shin [view email]
[v1]
Thu, 25 Sep 2025 10:57:13 UTC (925 KB)
[v2]
Fri, 26 Sep 2025 06:06:58 UTC (925 KB)
[v3]
Wed, 28 Jan 2026 06:50:35 UTC (507 KB)
[v4]
Wed, 8 Jul 2026 13:25:14 UTC (1,851 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。