Grupo de Tratamiento de Imágenes

 

 

News and Events 

GTI awarded the Lumiere Award for the Best Paper 

GTI was awarded the Lumiere Award for the Best Scientific Paper at the International Conference on 3D Immersion/Stereopsia in Brussels on December 2018.

The competitions for the “Lumiere Awards” have been organized by Stereopsia for the 7th consecutive year on behalf of the Advanced Imaging Society based in Hollywood, CA, for the territory consisting of Europe, the Middle East, and Africa (EMEA).

The awarded paper has been the result of the collaboration of GTI and VSENSE (in Trinity College Dublin):

Title: DeepStereoBrush: Interactive Depth Map Creation Authors: Sebastian Knorr, Matis Hudon, Julián Cabrera, Thomas Sikora, and Aljosa Smolic 

 

Abstract: In this paper, we introduce a novel interactive depth map creation approach for image sequences which uses depth-scribbles as input at user-defined keyframes. These scribbled depth values are then propagated within these keyframes and across the entire sequence using a 3-dimensional geodesic distance transform (3D-GDT). In order to further improve the depth estimation of the intermediate frames, we make use of a convolutional neural network (CNN) in an unconventional manner. Our process is based on online learning which allows us to specifically train a disposable network for each sequence individually using the user generated depth at keyframes along with corresponding RGB images as training pairs. Thus, we actually take advantage of one of the most common issues in deep learning: over-fitting. Furthermore, we integrated this approach into a professional interactive depth map creation application and compared our results against the state of the art in interactive depth map creation.