SIGGRAPH Asia 2008

Deep Photo: Model-Based Photograph Enhancement and Viewing

Johannes Kopf
University of Konstanz

   

Boris Neubert
University of Konstanz

   

Billy Chen
Microsoft

   

Michael F. Cohen
Microsoft Research

Daniel Cohen-Or
Tel Aviv University

   

Oliver Deussen
University of Konstanz

   

Matt Uyttendaele
Microsoft Research

   

Dani Lischinski
The Hebrew University


Some applications of the Deep Photo system.



Abstract

In this paper, we introduce a novel system for browsing, enhancing, and manipulating casual outdoor photographs by combining them with already existing georeferenced digital terrain and urban models. A simple interactive registration process is used to align a photograph with such a model. Once the photograph and the model have been registered, an abundance of information, such as depth, texture, and GIS data, becomes immediately available to our system. This information, in turn, enables a variety of operations, ranging from dehazing and relighting the photograph, to novel view synthesis, and overlaying with geographic information. We describe the implementation of a number of these applications and discuss possible extensions. Our results show that augmenting photographs with already available 3D models of the world supports a wide variety of new ways for us to experience and interact with our everyday snapshots.
@article{KNCCCDUL08,
    author  = {Johannes Kopf and Boris Neubert and Billy Chen and
               Michael F. Cohen and Daniel Cohen-Or and Oliver Deussen and
               Matt Uyttendaele and Dani Lischinski},
    title   = {Deep Photo: Model-Based Photograph Enhancement and Viewing},
    journal = {ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2008)},
    year    = {2008},
    volume  = {27},
    number  = {5},
    pages   = {116:1--116:10},
}
		
         
Paper
Paper (22.8 MB)
Video
Divx (66.5 MB)
Dehazing
Results
Relighting
Results