Deblurring Face Images with Exemplars

Jinshan Pan    Zhe Hu    Zhixun Su     Ming-Hsuan Yang

Algorithm Overview

Abstract

The human face is one of the most interesting subjects involved in numerous applications. Significant progress has been made towards the image deblurring problem, however, existing generic deblurring methods are not able to achieve satisfying results on blurry face images. The success of the state-of-the-art image deblurring methods stems mainly from implicit or explicit restoration of salient edges for kernel estimation. When there is not much texture in the blurry image (e.g., face images), existing methods are less effective as only few edges can be used for kernel estimation. Moreover, recent methods are usually jeopardized by selecting ambiguous edges, which are imaged from the same edge of the object after blur, for kernel estimation due to local edge selection strategies. In this paper, we address these problems of deblurring face images by exploiting facial structures. We propose a maximum a posteriori (MAP) deblurring algorithm based on an exemplar dataset, without using the coarse-to-fine strategy or ad-hoc edge selections. Extensive evaluations against state-of-the-art methods demonstrate the effectiveness of the proposed algorithm for deblurring face images. We also show the extendability of our method to other specific deblurring tasks.


Quantitative Evaluation on the Proposed Face Image Dataset

(a) Results on noise-free images (b) Results on noisy images
Quantitative comparison on the proposed face image datasets


More Examples and Comparisons

Blurred image Cho and Lee Siggraph Asia 2009 Xu et al. CVPR 2013 Ours
Blurred image Cho and Lee Siggraph Asia 2009 Xu et al. CVPR 2013 Ours

Extension of the Proposed Method

Blurred image Cho and Lee Siggraph Asia 2009 Xu et al. CVPR 2013 Ours

Technical Papers, Codes, and Datasets

Jinshan Pan, Zhe Hu, Zhixun Su, and Ming-Hsuan Yang, "Deblurring Face Images with Exemplars", European Conference on Computer Vision (ECCV), 2014

   Paper     
    MATALB code   
      Datasets


References

[1] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman. “Removing camera shake from a single photograph”, SIGGRAPH 2006.

[2] Q. Shan, J. Jia, and A. Agarwala. “High-quality motion deblurring from a single image”, SIGGRAPH 2008.

[3] H. Cho, J. Wang, and S. Lee, “Text image deblurring using text-specific properties,” ECCV, 2012.

[4] S. Cho and S. Lee. “Fast motion deblurring”, SIGGRAPH ASIA 2009.

[5] L. Xu and J. Jia. “Two-Phase Kernel Estimation for Robust Motion Deblurring”, ECCV 2010.

[6] L. Xu, S. Zheng, and J. Jia. “Unnatural L0 Sparse Representation for Natural Image Deblurring”, CVPR 2013.

[7] D. Krishnan, T. Tay and R. Fergus. “Blind Deconvolution using a Normalized Sparsity Measure”, CVPR 2011.

[8] A. Levin, Y. Weiss, F. Durand, and W. T. Freeman. "Efficient Marginal Likelihood Optimization in Blind Deconvolution", CVPR 2011.