Integrating innovative Spatial and Spectral Data Fusion strategies in Hyperspectral Imaging for Cultural Heritage

¹ Department of Physics, Politecnico di Milano, Piazza Leonardo da Vinci 32, Milano, Italy
² IFN-CNR, Piazza Leonardo da Vinci 32, 20133 Milan, Italy
³ Delft University of Technology, Department of Material Science and Engineering, Mekelweg 2, 2628 CD Delft

^* Corresponding author: This email address is being protected from spambots. You need JavaScript enabled to view it.

Published online: 22 September 2025

Abstract

The study of cultural heritage (CH) objects benefits greatly from non-invasive techniques like hyperspectral imaging (HSI), which enables material identification and spatial mapping. Due to the heterogeneous composition of CH artifacts, combining complementary techniques is essential for comprehensive analysis. However, handling such high-dimensional datasets remains a challenge. We present a computational protocol that combines spatial and spectral dimensionality reduction to enable early-stage fusion and efficient analysis of fused data, through multivariate methods, with a focus on Uniform Manifold Approximation and Projection (UMAP). We introduce an open-source plugin for Napari viewer, which allows for UMAP-based exploration of fused multimodal datasets. Our approach is demonstrated in case studies involving reflectance and photoluminescence data fusion, showcasing its effectiveness in detecting degradation phenomena and revealing material complexity in both plastic artifacts and historical paintings.