Skip to Main content Skip to Navigation

Spectral variability in hyperspectral unmixing : Multiscale, tensor, and neural network-based approaches

Abstract : The spectral signatures of the materials contained in hyperspectral images, also called endmembers (EMs), can be significantly affected by variations in atmospheric, illumination or environmental conditions typically occurring within an image. Traditional spectral unmixing (SU) algorithms neglect the spectral variability of the endmembers, what propagates significant mismodeling errors throughout the whole unmixing process and compromises the quality of the estimated abundances. Therefore, significant effort have been recently dedicated to mitigate the effects of spectral variability in SU. However, many challenges still remain in how to best explore a priori information about the problem in order to improve the quality, the robustness and the efficiency of SU algorithms that account for spectral variability. In this thesis, new strategies are developed to address spectral variability in SU. First, an (over)-segmentation-based multiscale regularization strategy is proposed to explore spatial information about the abundance maps more effectively. New algorithms are then proposed for both semi-supervised and blind SU, leading to improved abundance reconstruction performance at a small computational complexity. Afterwards, three new models are proposed to represent spectral variability of the EMs in SU, using parametric, tensor, and neural network-based representations for EM spectra at each image pixel. The parametric model introduces pixel-dependent scaling factors over a reference EM matrix to model arbitrary spectral variability, while the tensor-based representation allows one to exploit the high-dimensional nature of the data by means of its underlying low-rank structure. Generative neural networks (such as variational autoencoders or generative adversarial networks) finally allow one to model the low-dimensional manifold of the spectral signatures of the materials more effectively. The proposed models are used to devise three new blind SU algorithms, and to perform data augmentation in library-based SU. Finally, we provide a brief overview of work which extends the proposed strategies to new problems in SU and in hyperspectral image analysis. This includes the use of the multiscale abundance regularization in nonlinear SU, modeling spectral variability and accounting for sudden changes when performing SU and change detection of multitemporal hyperspectral images, and also accounting for spectral variability and changes in the multimodal (i.e., hyperspectral and multispectral) image fusion problem.
Complete list of metadata
Contributor : Abes Star :  Contact
Submitted on : Tuesday, June 8, 2021 - 1:26:09 PM
Last modification on : Wednesday, September 15, 2021 - 8:48:03 AM
Long-term archiving on: : Thursday, September 9, 2021 - 7:12:00 PM


Version validated by the jury (STAR)


  • HAL Id : tel-03253631, version 1



Ricardo Augusto Borsoi. Spectral variability in hyperspectral unmixing : Multiscale, tensor, and neural network-based approaches. Signal and Image processing. Université Côte d'Azur; Universidade federal de Santa Catarina (Brésil), 2021. English. ⟨NNT : 2021COAZ4012⟩. ⟨tel-03253631⟩



Record views


Files downloads