TY - JOUR
T1 - Deep gradual flash fusion for low-light enhancement
AU - Kim, Jae Woo
AU - Ryu, Je Ho
AU - Kim, Jong Ok
N1 - Funding Information:
This work was partially supported by the National Research Foundation of Korea (NRF), Ministry of Science and ICT (MSIT), South Korea, funded by the Korea Government, under Grant 2019R1A2C1005834 and partially by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-0-01749) supervised by the IITP (Institute of Information & Communications Technology Planning & Evaluation).
Publisher Copyright:
© 2020 Elsevier Inc.
Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2020/10
Y1 - 2020/10
N2 - In this paper, we propose gradual flash fusion, a new imaging concept that enables acquisition of pseudo multi-exposure images in a passive manner. This means that our gradual flash capture does not require any user-side manipulation (taking multiple shots or varying camera settings). Continuous high-speed capture naturally contains different intensities of flash in a single shooting. The captured gradual flash images, containing different information of the same scene, are fused to generate higher-quality images, especially in a low light scenario. For gradual flash fusion, we use a Generative Adversarial Network (GAN) based approach, where the generator is a tailored convolutional Auto-Encoder for image fusion. For the training, we build a custom dataset comprising gradual flash images and corresponding ground truths. This enables supervised learning, unlike most conventional image fusion studies. Experimental results demonstrate that gradual flash fusion achieves artifact-free and noise-free results resembling ground truth, owing to supervised adversarial fusion.
AB - In this paper, we propose gradual flash fusion, a new imaging concept that enables acquisition of pseudo multi-exposure images in a passive manner. This means that our gradual flash capture does not require any user-side manipulation (taking multiple shots or varying camera settings). Continuous high-speed capture naturally contains different intensities of flash in a single shooting. The captured gradual flash images, containing different information of the same scene, are fused to generate higher-quality images, especially in a low light scenario. For gradual flash fusion, we use a Generative Adversarial Network (GAN) based approach, where the generator is a tailored convolutional Auto-Encoder for image fusion. For the training, we build a custom dataset comprising gradual flash images and corresponding ground truths. This enables supervised learning, unlike most conventional image fusion studies. Experimental results demonstrate that gradual flash fusion achieves artifact-free and noise-free results resembling ground truth, owing to supervised adversarial fusion.
KW - Auto-encoder
KW - Flash fusion
KW - GAN
KW - Image fusion
KW - Low light enhancement
KW - Pseudo multi-exposure
UR - http://www.scopus.com/inward/record.url?scp=85091476698&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85091476698&partnerID=8YFLogxK
U2 - 10.1016/j.jvcir.2020.102903
DO - 10.1016/j.jvcir.2020.102903
M3 - Article
AN - SCOPUS:85091476698
SN - 1047-3203
VL - 72
JO - Journal of Visual Communication and Image Representation
JF - Journal of Visual Communication and Image Representation
M1 - 102903
ER -