Deep Learning for Transient Image Reconstruction from ToF DataView Publication
In this work, we propose a novel approach for correcting multi-path interference (MPI) in Time-of-Flight (ToF) cameras by estimating the direct and global components of the incoming light. MPI is an error source linked to the multiple reflections of light inside a scene; each sensor pixel receives information coming from different light paths which generally leads to an overestimation of the depth. We introduce a novel deep learning approach, which estimates the structure of the time-dependent scene impulse response and from it recovers a depth image with a reduced amount of MPI. The model consists of two main blocks: a predictive model that learns a compact encoded representation of the backscattering vector from the noisy input data and a fixed backscattering model which translates the encoded representation into the high dimensional light response. Experimental results on real data show the effectiveness of the proposed approach, which reaches state-of-the-art performances.
Related PublicationsView All
Unsupervised Domain Adaptation of Deep Networks for ToF Depth Refinement
Gianluca Agresti, Henrik Schäfer, Piergiorgio Sartor, Yalcin Incesu, Pietro Zanuttigh*Depth maps acquired with ToF cameras have a limited accuracy due to the high noise level and to the multi-path […]
Semi-supervised Deep Learning Techniques for Spectrum Reconstruction
Adriano Simonetto*, Pietro Zanuttigh*, Vincent Parret, Piergiorgio Sartor, Alexander GattoState-of-the-art approaches for the estimation of hyperspectral images (HSI) from RGB data are mostly based on […]