Abstract:HyperSpectral-MultiSpectral Image (HSI-MSI) fusion aims to recover a high-resolution hyperspectral image from a low-resolution HSI and a high-resolution MSI. Classical methods such as Coupled Nonnegative Matrix Factorization (CNMF) benefit from a strong physical interpretability but suffer from inferior results compared to their deep-learning counterparts. To address this limitation, we propose SCALMU (Synthetically-trained Coupling of Adaptive Learned Multiplicative Updates), a novel blind unrolled neural network architecture that integrates adaptive learnable matrices within the classical framework of CNMF multiplicative updates, improving its results. Due to its architectural proximity with CNMF, the resulting algorithm preserves physical interpretability and nonnegativity constraints. To overcome the scarcity of supervised training data, we generate a synthetic HSI-MSI dataset using the dead leaves model and train SCALMU end-to-end under synthetic supervision. Experiments on several datasets show that SCALMU outperforms state-of-the-art methods and highlights the potential of blind fusion trained with synthetic data. The code is available at this https URL
From: Xinxin Xu [view email] [via CCSD proxy]
[v1]
Fri, 29 May 2026 08:13:38 UTC (30,073 KB)
[v2]
Fri, 10 Jul 2026 06:56:55 UTC (32,753 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。