We propose a novel method for adjusting luminance for multi-exposure image fusion. For the adjustment, two novel scene segmentation approaches based on luminance distribution are also proposed. Multi-exposure image fusion is a method for producing images that are expected to be more informative and perceptually appealing than any of the input ones, by directly fusing photos taken with different exposures. However, existing fusion methods often produce unclear fused images when input images do not have a sufficient number of different exposure levels. In this paper, we point out that adjusting the luminance of input images makes it possible to improve the quality of the final fused images. This insight is the basis of the proposed method. The proposed method enables us to produce high-quality images, even when undesirable inputs are given. Visual comparison results show that the proposed method can produce images that clearly represent a whole scene. In addition, multi-exposure image fusion with the proposed method outperforms state-of-the-art fusion methods in terms of MEF-SSIM, discrete entropy, tone mapped image quality index, and statistical naturalness.
Codes are available on GitHub.
When you use this implementation for your research work, please cite the paper.
Yuma KINOSHITA and Hitoshi KIYA,“Scene Segmentation-Based Luminance Adjustment for Multi-Exposure Image Fusion,”IEEE Trans. Image Processing, 2019 (to be published).@article{kinoshita2019scene,author = {Kinoshita, Yuma and Kiya, Hitoshi},doi = {10.1109/TIP.2019.2906501},issn = {1057-7149},journal = {IEEE Trans. Image Processing.},volume = {28},number = {8},pages = {4101--4116},title = {{Scene Segmentation-Based Luminance Adjustment for Multi-Exposure Image Fusion}},url = {https://ieeexplore.ieee.org/document/8672126/},month = {Aug.},year = {2019}}