Publications‎ > ‎

Transformation Guided Image Completion


Back to publications page

International Conference on Computational Photography 2013


Transformation Guided Image Completion

Jia-Bin Huang Johannes Kopf     Narendra Ahuja  Sing Bing Kang    
University of Illinois, Urbana-Champaign Microsoft Research    University of Illinois, Urbana-Champaign   Microsoft Research    





Abstract

In this paper, we describe a new interactive image completion system that allows users to easily specify various forms of mid-level structures in the image. Our system supports the specification of four basic symmetric types: reflection, translation, rotation, and glide. The user inputs are automatically converted into guidance maps that encode possible candidate shifts and, indirectly, local transformations of rotation and scale. These guidance maps are used in conjunction with a color matching cost for image completion. We show that our system is capable of handling a variety of challenging examples.

Citation


Jia-Bin Huang, Johannes Kopf, Narendra Ahuja, and Sing Bing Kang, Transformation Guided Image Completion. International Conference on Computational Photography, 2013


Bibtex

@inproceedings{Huang-ICCP-2013,
    Author = {Huang, J-. B. and Kopf, J. and Ahuja, N. and Kang, S. B.},
    title = {Transformation Guided Image Completion},
    booktitle = {International Conference on Computational Photography},
    Month = {April},
    Year = 2013
}


 
Paper 
High-res [PDF] (28 MB)
Low-res  [PDF] (8.1 MB)

Supplementary Material
High-res [PDF] (43 MB)
Low-res [PDF]  (14 MB)

Download dataset

- Data 
[Link] (66 MB)
- Readme [Link]


Slide
- [PDF]
- [PPT]
 


Experimental Results

Comparison with state-of-the-art image completion algorithms


  • Ramp gradient

 Original Image  Mask  Positional guidance map
 Our result  [Image melding]  [Transforming Image Completion]
 [Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]


Original Image [source]  Mask  Positional guidance map
Our result  [Image melding]  [Transforming Image Completion]
  [Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]


  • Translational symmetry


Original Image [source]  Mask  Positional guidance map

Our result  [Image melding]  [Transforming Image Completion]
  [Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]


Original Image  Mask  Positional guidance map

Our result  [Image melding]  [Transforming Image Completion]
[Example-based inpainting]  [Priority-BP [Photoshop content-aware fill]


Original Image [source]  Mask  Positional guidance map
Our result  [Image melding]  [Transforming Image Completion]
  [Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]


N/A

Original Image [source]  Mask  Positional guidance map


Our result  [Image melding]  [Transforming Image Completion]

  [Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]



  • Reflectional Symmetry

Original Image [source]  Mask  Positional guidance map
Our result  [Image melding]  [Transforming Image Completion]
[Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]



Original Image [source]  Mask  Positional guidance map

 
Our result  [Image melding]  [Transforming Image Completion]
[Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]

  • Rotational symmetry

Original image [source]
 Mask  Positional guidance map
Our result  [Image melding]  [Transforming Image Completion]
[Example-based inpainting] [Priority-BP [Photoshop content-aware fill]


Original Image [source]  Mask  Positional guidance map

Our result  [Image melding]  [Transforming Image Completion]
[Example-based inpainting]  [Priority-BP  [Photoshop content-aware fill]



Original Image [source]  Mask  Positional guidance map
Our result  [Image melding]  [Transforming Image Completion]
[Example-based inpainting] [Priority-BP [Photoshop content-aware fill]



Original Image [source]  Mask  Positional guidance map
Our result  [Image melding] [Transforming Image Completion]

[Example-based inpainting] [Priority-BP [Photoshop content-aware fill]

  • Compositional guidance map
Original Image  Mask  Positional guidance map


Our result  [Image melding] [Transforming Image Completion]



[Example-based inpainting] [Priority-BP [Photoshop content-aware fill]


Original Image [source]
 Mask  Positional guidance map
Our result  [Image melding] [Transforming Image Completion]
[Example-based inpainting] [Priority-BP [Photoshop content-aware fill]

  • Failure cases

  • Effect of positional and non-positional guidance
 Image with mask  [Photoshop content-aware fill]  Ours (unguided)
 Ours (positional guidance only)  Ours (non-positional only)  Ours (both positional and non-positional)


www hitwebcounter com

Comments