Detail Enhancement

Image/Video Detail Enhancement by Decomposition

Image/Video Enhancement

• • pixel-domain;

  • frequency domain.

Detail Enhancement:

• • Denoising-based enhancement;

  • Sharpness-based enhancement;

    • • High pass filter;

      • High boost filter;

      • Unsharp masking: enhance the edge by subtraction of smoothed from original (avoid halo by nonlinear filters);

• Contrast-based enhancement:

  • • Spatial uniform ones: linear contrast stretch, histogram equalization;

    • Spatial non-uniform ones: adaptive histogram equalization, tone mapping.

• HDR-based enhancement.

Edge Aware/Preserving Filter:

• • TV (Total Variation) for edge preserving filtering;

  • Anistropic diffusion (robust);

  • Bilateral filter;

  • Weighted LS method;

  • EAW (Edge Avoiding Wavelet) filter;

  • Non-local means;

  • L0 Gradient minimization;

  • Domain Transform for edge preserving filtering;

  • Local Laplacian Filters for edge preserving processing;

  • BM3D (block matching 3-d collaborative filtering).

Multiscale Image Decomposition:

• • Smooth base layer (or illumination, large scale variations);

  • Residual detail layer (or reflectance, small scale details);

Detail Manipulation:

• • Contrast expansion/compression;

  • Compression in base layer;

  • Enhance in detail layers.

Fig. 1, Detail Multi-Scale Decomposition for Enhancement with BM3D Filter

Fig. 2, Demo GUI in Detail Enhancement

Fig. 3, An Example (top 3 rows are smoothed and detailed, bottom row is original and enhanced)

Fig. 4, Some enhancement results (left: input, right: enhanced)

References

1. J. Tumblin, G. Turk, LCIS: a boundary hierarchy for detail-preserving contrast reduction, Siggraph, 1999.

2. Z. Farbman et al., Edge-preserving decompositions for multi-scale tone and detail manipulation, Siggraph, 2008.

3. E. Gastal, M. Oliveira, Domain transform for edge-aware image and video processing, ACM SIGGRAPH 2011.

4. L. Xu et al., Image smoothing via l0 gradient minimization, ACM SIGGRAPH Asia 2011.

5. G Deng, A generalized unsharp masking algorithm, IEEE T-IP, 20(5), 2011.

6. J A Stark, Adaptive image contrast enhancement using generalizations of histogram equalization, IEEE T-IP, 9(5), 2000.

7. Raanan Fattal, Edge-Avoiding Wavelets and their Applications, ACM Trans. Graph., 28(3), 2009.

8. Sylvain Paris, Samuel W. Hasinoff, Jan Kautz, Local Laplacian Filters: Edge-aware Image Processing with a Laplacian Pyramid , ACM SIGGRAPH, 2011.