SIGGRAPH 2015A Computational Approach for Obstruction-Free Photography
Tianfan Xue1* Michael Rubinstein2* Ce Liu2* William T. Freeman1,2
AbstractWe present a unified computational approach for taking photos through reflecting or occluding elements such as windows and fences. Rather than capturing a single image, we instruct the user to take a short image sequence while slightly moving the camera. Differences that often exist in the relative position of the background and the obstructing elements from the camera allow us to separate them based on their motions, and to recover the desired background scene as if the visual obstructions were not there. We show results on controlled experiments and many real and practical scenarios, including shooting through reflections, fences, and raindrop-covered windows.
@article{Xue2015ObstructionFree, author = {Tianfan Xue and Michael Rubinstein and Ce Liu and William T. Freeman},
title = {A Computational Approach for Obstruction-Free Photography},
journal = {ACM Transactions on Graphics (Proc. SIGGRAPH)},
year = {2015},
volume = {34},
number = {4},
}
Paper: PDF (32MB)
Technical Report: PDF
DataInput sequences and results: .zip (280mb)
The zip file contains the following files for each sequence:
"gallery" is an image sequence from "Image-Based Rendering for Scenes with Reflections", Sinha et al. 2012, and doesn't contain a "_fullseq.mp4" file.
Controlled experiments with ground-truth decomposition: .zip (32mb) The zip file contains the following files for each sequence:
Acknowledgements
We thank Dr. Rick Szeliski for useful discussions and feedback, and the anonymous SIGGRAPH reviewers for their comments. We thank Katie Bouman for narrating our video. Tianfan Xue is supported by Shell Research and ONR MURI 6923196.
|
