DeFlare-Net: Flare Detection and Removal Network
Allabakash G, Ankit Raichur, Vinod Patil, Swaroop A, Sampada Malagi, Nikhil Akalwadi, Chaitra Desai, Ramesh Ashok Tabib, Ujwala Patil, Uma Mudenagudi
Abstract
In this paper, we propose DeFlare-Net to detect, and remove flares. Typically, flares in hand-held devices are inherent due to internal reflection of light and forward scattering of lens material. The distortions due to flares limit the applications in the field of computer vision. Research challenges towards detection and removal of flare persist due to multiple occurrences of flare with varying intensities. The performance of existing flare removal methods are sensitive to the assumption of underlying physics and geometry, leading to artefacts in the deflared image. The current approaches for deflaring involve elimination of light-source implicitly, whilst removal of flare from the image leading to loss of information. Towards this, we propose DeFlare-Net for detection, and removal of flares, while retaining light-source. In this framework, we include Light Source Detection (LSD) module for detection of light-source, and Flare Removal Network (FRN) to remove the flares. Unlike state-of-the-art methods, we propose a novel loss function and call it as DeFlare loss . The loss includes flare loss , light-source loss , and reconstruction loss towards removal of flare. We demonstrate the results of proposed methodology on benchmark datasets in comparison with SOTA techniques using appropriate quantitative metrics.
Results of our proposed DeFlare-Net: Detection and Removal of Flares From Images
Input flare image
Flare Removed Images
Input flare image
Flare Removed Image
Input flare image
Flare Removed Image
Input image
Flare Removed Image
Questions?
Contact nikhil.akalwadi@kletech.ac.in to get more information on the project
BibTeX
@inproceedings{10.1007/978-3-031-45170-6_48,
abstract = {In this paper, we propose DeFlare-Net to detect, and remove flares. Typically, flares in hand-held devices are inherent due to internal reflection of light and forward scattering of lens material. The distortions due to flares limit the applications in the field of computer vision. Research challenges towards detection and removal of flare persist due to multiple occurrences of flare with varying intensities. The performance of existing flare removal methods are sensitive to the assumption of underlying physics and geometry, leading to artefacts in the deflared image. The current approaches for deflaring involve elimination of light-source implicitly, whilst removal of flare from the image leading to loss of information. Towards this, we propose DeFlare-Net for detection, and removal of flares, while retaining light-source. In this framework, we include Light Source Detection (LSD) module for detection of light-source, and Flare Removal Network (FRN) to remove the flares. Unlike state-of-the-art methods, we propose a novel loss function and call it as DeFlare loss {\$}{\$}L{\_}{\{}DeFlare{\}}{\$}{\$}LDeFlare. The loss {\$}{\$}L{\_}{\{}DeFlare{\}}{\$}{\$}LDeFlareincludes flare loss {\$}{\$}L{\_}{\{}flare{\}}{\$}{\$}Lflare, light-source loss {\$}{\$}L{\_}{\{}ls{\}} {\$}{\$}Lls, and reconstruction loss {\$}{\$}L{\_}{\{}recon{\}}{\$}{\$}Lrecontowards removal of flare. We demonstrate the results of proposed methodology on benchmark datasets in comparison with SOTA techniques using appropriate quantitative metrics.},
address = {Cham},
author = {Ghodesawar, Allabakash and Patil, Vinod and Raichur, Ankit and Adrashyappanamath, Swaroop and Malagi, Sampada and Akalwadi, Nikhil and Desai, Chaitra and Tabib, Ramesh Ashok and Patil, Ujwala and Mudenagudi, Uma},
booktitle = {Pattern Recognition and Machine Intelligence},
editor = {Maji, Pradipta and Huang, Tingwen and Pal, Nikhil R. and Chaudhury, Santanu and De, Rajat K.},
isbn = {978-3-031-45170-6},
pages = {465--472},
publisher = {Springer Nature Switzerland},
title = {DeFlare-Net: Flare Detection and Removal Network},
year = {2023}}
[nikhil.akalwadi@kletech.ac.in] | [CEVI-KLE Technological University, Vidyanagar, Hubballi-580031] |