TY - JOUR
T1 - Low-FaceNet
T2 - Face Recognition-Driven Low-Light Image Enhancement
AU - Fan, Yihua
AU - Wang, Yongzhen
AU - Liang, Dong
AU - Chen, Yiping
AU - Xie, Haoran
AU - Wang, Fu Lee
AU - Li, Jonathan
AU - Wei, Mingqiang
N1 - Publisher Copyright:
© 1963-2012 IEEE.
PY - 2024
Y1 - 2024
N2 - Images captured in low-light conditions often induce the performance degradation of cutting-edge face recognition models. The missing and wrong face recognition inevitably makes vision-based systems operate poorly. In this article, we propose Low-FaceNet, a novel face recognition-driven network, to make low-light image enhancement (LLE) interact with high-level recognition for realizing mutual gain under a unified deep learning framework. Unlike existing methods, Low-FaceNet uniquely brightens real-world images by unsupervised contrastive learning and absorbs the wisdom of facial understanding. Low-FaceNet possesses an image enhancement network that is assembled by four key modules: a contrastive learning module, a feature extraction module, a semantic segmentation module, and a face recognition module. These modules enable Low-FaceNet to not only improve the brightness contrast and retain features but also increase the accuracy of recognizing faces in low-light conditions. Furthermore, we establish a new dataset of low-light face images called LaPa-Face. It includes detailed annotations with 11 categories of facial features and identity labels. Extensive experiments demonstrate our superiority against the state-of-the-art methods of both LLE and face recognition even without ground-truth image labels. Our code and dataset are available at https://github.com/fanyihua0309/Low-FaceNet.
AB - Images captured in low-light conditions often induce the performance degradation of cutting-edge face recognition models. The missing and wrong face recognition inevitably makes vision-based systems operate poorly. In this article, we propose Low-FaceNet, a novel face recognition-driven network, to make low-light image enhancement (LLE) interact with high-level recognition for realizing mutual gain under a unified deep learning framework. Unlike existing methods, Low-FaceNet uniquely brightens real-world images by unsupervised contrastive learning and absorbs the wisdom of facial understanding. Low-FaceNet possesses an image enhancement network that is assembled by four key modules: a contrastive learning module, a feature extraction module, a semantic segmentation module, and a face recognition module. These modules enable Low-FaceNet to not only improve the brightness contrast and retain features but also increase the accuracy of recognizing faces in low-light conditions. Furthermore, we establish a new dataset of low-light face images called LaPa-Face. It includes detailed annotations with 11 categories of facial features and identity labels. Extensive experiments demonstrate our superiority against the state-of-the-art methods of both LLE and face recognition even without ground-truth image labels. Our code and dataset are available at https://github.com/fanyihua0309/Low-FaceNet.
KW - Contrastive learning
KW - Low-FaceNet
KW - face recognition
KW - low-light image enhancement
KW - semantic segmentation
UR - http://www.scopus.com/inward/record.url?scp=85188918082&partnerID=8YFLogxK
U2 - 10.1109/TIM.2024.3372230
DO - 10.1109/TIM.2024.3372230
M3 - Article
AN - SCOPUS:85188918082
SN - 0018-9456
VL - 73
SP - 1
EP - 13
JO - IEEE Transactions on Instrumentation and Measurement
JF - IEEE Transactions on Instrumentation and Measurement
M1 - 5019413
ER -