Semi-supervised Deep Learning Techniques for Spectrum ReconstructionView Publication
State-of-the-art approaches for the estimation of hyperspectral images (HSI) from RGB data are mostly based on deep learning techniques but due to the lack of training data their performances are limited to uncommon scenarios where a large hyperspectral database is available. In this work we present a family of novel deep learning schemes for hyperspectral data estimation able to work when the hyperspectral information at our disposal is limited. Firstly, we introduce a learning scheme exploiting a physical model based on the backward mapping to the RGB space and total variation regularization that can be trained with a limited amount of HSI images. Then, we propose a novel semi-supervised learning scheme able to work even with just a few pixels labeled with hyperspectral information. Finally, we show that the approach can be extended to a transfer learning scenario. The proposed techniques allow to reach impressive performances while requiring only some HSI images or just a few pixels for the training.
Related PublicationsView All
Unsupervised Domain Adaptation of Deep Networks for ToF Depth Refinement
Gianluca Agresti, Henrik Schäfer, Piergiorgio Sartor, Yalcin Incesu, Pietro Zanuttigh*Depth maps acquired with ToF cameras have a limited accuracy due to the high noise level and to the multi-path […]
Deep Learning for Transient Image Reconstruction from ToF Data
Enrico Buratto*, Adriano Simonetto*, Gianluca Agresti, Henrik Schäfer, Pietro Zanuttigh*In this work, we propose a novel approach for correcting multi-path interference (MPI) in Time-of-Flight (ToF) […]