SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

3 Aug 2024 | Guanyiman Fu, Fengchao Xiong, Member, IEEE, Jianfeng Lu, Member, IEEE and Jun Zhou, Senior Member, IEEE
**SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising** This paper introduces SSUMamba, a novel approach for hyperspectral image (HSI) denoising that leverages the spatial-spectral continuous scan (SSCS) Mamba block. The method aims to model long-range spatial-spectral correlations in HSI denoising, addressing the challenges posed by noise arising from intra-imaging mechanisms and environmental factors. The SSCS Mamba block alternates row, column, and band in six different orders to generate sequences and uses a bidirectional state space model (SSM) to exploit long-range spatial-spectral dependencies. Additionally, residual 3D convolutions are incorporated to enhance local spatial-spectral modeling. Experimental results on synthetic and real-world datasets demonstrate that SSUMamba achieves superior denoising performance with lower memory consumption per batch compared to transformer-based methods. The source code is available at https://github.com/Ironkitty/SSUMamba. **Key Contributions:** - Introduction of the spatial-spectral U-Mamba (SSUMamba) for HSI denoising. - Development of the spatial-spectral continuous scan (SSCS) Mamba block to generate continuous sequences and model long-range spatial-spectral dependencies. - Incorporation of residual 3D convolutional blocks to enhance local spatial-spectral modeling. - Superior denoising performance with fewer parameters and lower memory consumption per batch compared to transformer-based methods. **Method Overview:** - SSUMamba is designed to learn the mapping from noisy HSI to clean HSI. - The model consists of a feature extractor, encoder blocks, SSCS Mamba blocks, decoder blocks with skip connections, and a reconstructor. - The SSCS Mamba block uses a bidirectional SSM with SSCS to capture both local and global spatial-spectral correlations and continuity. - The model is trained using a loss function that minimizes the $L_2$ distance between the predicted clean HSI and the ground truth clean HSI. **Experimental Results:** - SSUMamba outperforms other methods in terms of PSNR, SSIM, and SAM metrics on synthetic datasets. - It demonstrates superior denoising performance on real-world HSIs, including the Gaofen-5 Wuhan HSI and Earth Observing-1 HSI. - Ablation studies show the effectiveness of the SSCS scan schemes, bidirectional SSM, and residual blocks. - Network width experiments confirm that increasing the network width improves performance, with SSUMamba achieving better results compared to transformer-based methods in terms of parameters, memory consumption, and inference time. **Conclusion:** SSUMamba effectively models long-range spatial-spectral correlations in HSI denoising, achieving state-of-the-art performance with reduced computational complexity. Future work will explore more efficient network designs and integrate the SSCS Mamba block into other tasks.**SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising** This paper introduces SSUMamba, a novel approach for hyperspectral image (HSI) denoising that leverages the spatial-spectral continuous scan (SSCS) Mamba block. The method aims to model long-range spatial-spectral correlations in HSI denoising, addressing the challenges posed by noise arising from intra-imaging mechanisms and environmental factors. The SSCS Mamba block alternates row, column, and band in six different orders to generate sequences and uses a bidirectional state space model (SSM) to exploit long-range spatial-spectral dependencies. Additionally, residual 3D convolutions are incorporated to enhance local spatial-spectral modeling. Experimental results on synthetic and real-world datasets demonstrate that SSUMamba achieves superior denoising performance with lower memory consumption per batch compared to transformer-based methods. The source code is available at https://github.com/Ironkitty/SSUMamba. **Key Contributions:** - Introduction of the spatial-spectral U-Mamba (SSUMamba) for HSI denoising. - Development of the spatial-spectral continuous scan (SSCS) Mamba block to generate continuous sequences and model long-range spatial-spectral dependencies. - Incorporation of residual 3D convolutional blocks to enhance local spatial-spectral modeling. - Superior denoising performance with fewer parameters and lower memory consumption per batch compared to transformer-based methods. **Method Overview:** - SSUMamba is designed to learn the mapping from noisy HSI to clean HSI. - The model consists of a feature extractor, encoder blocks, SSCS Mamba blocks, decoder blocks with skip connections, and a reconstructor. - The SSCS Mamba block uses a bidirectional SSM with SSCS to capture both local and global spatial-spectral correlations and continuity. - The model is trained using a loss function that minimizes the $L_2$ distance between the predicted clean HSI and the ground truth clean HSI. **Experimental Results:** - SSUMamba outperforms other methods in terms of PSNR, SSIM, and SAM metrics on synthetic datasets. - It demonstrates superior denoising performance on real-world HSIs, including the Gaofen-5 Wuhan HSI and Earth Observing-1 HSI. - Ablation studies show the effectiveness of the SSCS scan schemes, bidirectional SSM, and residual blocks. - Network width experiments confirm that increasing the network width improves performance, with SSUMamba achieving better results compared to transformer-based methods in terms of parameters, memory consumption, and inference time. **Conclusion:** SSUMamba effectively models long-range spatial-spectral correlations in HSI denoising, achieving state-of-the-art performance with reduced computational complexity. Future work will explore more efficient network designs and integrate the SSCS Mamba block into other tasks.
Reach us at info@study.space
Understanding SSUMamba%3A Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising