April 6th, 2012 @ 2:30pm Bryan Russell (UW)

Automatic Alignment of Paintings and Photographs Depicting a 3D Scene

This work addresses the problem of automatically aligning historical architectural paintings with 3D models obtained using multi-view stereo technology from modern photographs. This is a challenging task because of the variations in appearance, geometry, color and texture due to environmental changes over time, the nonphotorealistic nature of architectural paintings, and differences in the viewpoints used by the painters and photographers. Our alignment procedure consists of two novel aspects: (i) we combine the gist descriptor with the view-synthesis/retrieval of Irschara et al. to obtain a coarse alignment of the painting to the 3D model, and (ii) we have developed an ICP-like viewpoint refinement procedure, where 3D surface orientation discontinuities (folds and creases) and view-dependent occlusion boundaries are rendered from the automatically obtained and noisy 3D model in a view-dependent manner and matched to gPB contours extracted from the paintings. We demonstrate the alignment of XIXth Century architectural watercolors of the Casa di Championnet in Pompeii with a 3D model constructed from modern photographs using the PMVS public-domain multi-view stereo software.

http://www.di.ens.fr/willow/research/paintingalignment/ Joint work with Josef Sivic, Jean Ponce, Hélène Dessales


Bryan Russell is a research scientist at the University of Washington and collaborates closely with the Intel Science and Technology Center (ISTC) on pervasive computing. His research is in the area of computer vision, with particular interests in object recognition and scene understanding. Bryan received his PhD in 2007 from MIT and was a postdoctoral fellow in the INRIA Willow team at the Ecole Normale Supérieure in Paris, France from 2008-2010.

seminars/seminaritems/2012-04-06.txt · Last modified: 2012/04/02 12:04 by silberman