|
|
|
|
|
|
| Research on Low Illumination Image Enhancement Method Based on Spectral Reflectance |
| MA Xiang-cai1, 2, CAO Qian2, BAI Chun-yan2, WANG Xiao-hong3, ZHANG Da-wei1* |
1. School of Optical Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
2. Department of Printing and Packaging Engineering, Shanghai Publishing and Printing College, Shanghai 20093, China
3. College of Communication and Art Design, University of Shanghai for Science and Technology, Shanghai 200093, China
|
|
|
|
|
Abstract Low illumination image enhancement technology is one of the research hotspots of computer vision. The theoretical algorithm of Retinex assumes that the image is the product of the reflection component and the illumination component. It restores the image by removing or correcting the illumination component and combining the reflection component of the object, which is widely used in traditional algorithms and deep learning enhancement models. Spectral reflectance is the fingerprint of color, and multispectral images have more information than RGB images. Colorimetric theory and Retinex theory agree that the color of an image depends on reflection data, but spectral reflectance is obtained based on instrument measurement, and the image reflection component is obtained based on image hypothesis decomposition. The literature has not studied the enhancement of low-light images from the perspective of spectral reflectance. Inspired by Retinex theory and combined with the strong nonlinear fitting ability of deep learning, a low illumination image enhancement method based on spectral reflectance is proposed. The spectral reflectance of color is used to replace the image reflection component in the RetinexNet network, and the spectral power distribution of the CIE standard light source is used to replace the image illumination component in the network. Firstly, the spectral reflectance of normal light images in the image database is reconstructed to build a multispectral image dataset of low illumination and normal light images. Then, the deep learning network model is trained to convert low-illumination images into the multispectral images. Any low illuminance image is obtained from the multispectral image through the network model, and the multispectral image is obtained from the CIEXYZ tristimulus according to the colorimetric theory and then converted to the RGB color space for display through the standard color space.The method is trained and tested on the public LOL dataset, and the results show that this method is superior to the standard methods in image noise suppression and color restoration, which proves the superiority and effectiveness of this method for low illumination image enhancement.
|
|
Received: 2022-09-06
Accepted: 2022-11-25
|
|
|
|
Corresponding Authors:
ZHANG Da-wei
E-mail: dwzhang@usst.edu.cn
|
|
[1] Jobson D J, Rahman Z U, Woodel G A. IEEE Transactions on Image Processing, 1997, 6(3): 451.
[2] Jobson D J, Rahman Z, Woodell G A. IEEE Transactions on Image Processing, 1997, 6(7): 965.
[3] Rahman Z-U, Jobson D J, Woodell G A. Journal of Electronic Imaging, 2004, 13(1): 100.
[4] Park S, Yu S, Moon B, et al. IEEE Transactions on Consumer Electronics, 2017, 63(2): 178.
[5] Guo X, Li Y, Ling H. IEEE Transactions on Image Processing, 2017, 26(2): 982.
[6] Li C, Guo J, Porikli F, et al. Pattern Recognition Letters, 2018, 104: 15.
[7] Lü X, Sun Y, Zhang J, et al. Signal Processing: Image Communication, 2021, 99: 116466.
[8] Zhang Y, Zhang J, Guo X. Proceedings of the 27th ACM International Conference on Multimedia, 2019: 1632.
[9] Zhang Y, Di X, Zhang B, et al. arXiv: 2002. 11300v1, 2020.
[10] Liang J X, Xiao K D, Hu X R. Optics Express, 2021, 29(26): 43899.
[11] Wu G. Laser Physics Letters, 2019, 16 (8): 085208.
[12] XIAO Ying, MA Xiang-cai, WANG Dong-dong, et al(肖 颖, 麻祥才, 王东东, 等). Optical Technique(光学技术), 2019, 45(6): 696.
[13] He K, Zhang X, Ren S, et al. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016: 770.
[14] Wei C, Wang W, Yang W, et al. arXiv: 1808. 04560v1, 2018.
[15] Luo M R, Cui G, Rigg B. Color Research & Application, 2001, 26(5): 340.
[16] Wang K, Wang Z, Zhang L, et al. Current Optics and Photonics, 2020, 4(1): 1.
[17] Wang Z, Bovik A C, Sheikh H R, et al. IEEE Transactions on Image Processing, 2004, 13(4): 600.
[18] Wang S, Zheng J, Hu H-M, et al. IEEE Transactions on Image Processing, 2013, 22(9): 3538.
[19] Li M, Liu J, Yang W, et al. IEEE Transactions on Image Processing, 2018, 27(6): 2828.
|
| [1] |
TANG Jie1, LUO Yan-bo2, LI Xiang-yu2, CHEN Yun-can1, WANG Peng1, LU Tian3, JI Xiao-bo4, PANG Yong-qiang2*, ZHU Li-jun1*. Study on One-Dimensional Convolutional Neural Network Model Based on Near-Infrared Spectroscopy Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(03): 731-736. |
| [2] |
ZHANG Mei-ling, CHEN Yong-jie, WANG Min-juan, LI Min-zan, ZHENG Li-hua*. A Hyperspectral Deep Learning Model for Predicting Anthocyanin
Content in Purple Leaf Lettuce[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(03): 865-871. |
| [3] |
ZHANG Hai-liang1, ZHOU Xiao-wen1, LIU Xue-mei2*, LUO Wei2, ZHAN Bai-shao2, PAN Fan3. Freshness Identification of Turbot Based on Convolutional Neural
Network and Hyperspectral Imaging Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(02): 367-371. |
| [4] |
MA Yuan, LI Ri-hao, ZHANG Wei-feng*. Research on the Training Samples Selection for Spectral Reflectance
Reconstruction Based on Improved Weighted Euclidean Distance[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3924-3929. |
| [5] |
ZHU Zhi-cheng1, WU Yong-feng2*, MA Jun-cheng2, JI Lin2, LIU Bin-hui3*, JIN Hai-liang1*. Response of Winter Wheat Canopy Spectra to Chlorophyll Changes Under Water Stress Based on Unmanned Aerial Vehicle Remote Sensing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3524-3534. |
| [6] |
WANG Yu-chen1, 2, KONG Ling-qin1, 2, 3*, ZHAO Yue-jin1, 2, 3, DONG Li-quan1, 2, 3*, LIU Ming1, 2, 3, HUI Mei1, 2. Hyperspectral Reconstruction From RGB Images for Tissue Oxygen
Saturation Assessment[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 3193-3201. |
| [7] |
YE Wen-chao1, LUO Shui-yang1, LI Jin-hao1, LI Zhao-rong1, FAN Zhi-wen1, XU Hai-tao1, ZHAO Jing1, LAN Yu-bin1, 2, DENG Hai-dong1*, LONG Yong-bing1, 2, 3*. Research on Classification Method of Hybrid Rice Seeds Based on the Fusion of Near-Infrared Spectra and Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2935-2941. |
| [8] |
TANG Ting, PAN Xin*, LUO Xiao-ling, GAO Xiao-jing. Fusion of ConvLSTM and Multi-Attention Mechanism Network for
Hyperspectral Image Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2608-2616. |
| [9] |
MAO Yi-lin1, LI He1, WANG Yu1, FAN Kai1, SUN Li-tao2, WANG Hui3, SONG Da-peng3, SHEN Jia-zhi2*, DING Zhao-tang1, 2*. Quantitative Judgment of Freezing Injury of Tea Leaves Based on Hyperspectral Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2266-2271. |
| [10] |
DAI Shuo1, XIA Qing1*, ZHANG Han1, HE Ting-ting2, ZHENG Qiong1, XING Xue-min1, LI Chong3. Constructing of Tidal Flat Extraction Index in Coastal Zones Using Sentinel-2 Multispectral Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1888-1894. |
| [11] |
LIU Si-qi1, FENG Guo-hong1*, TANG Jie2, REN Jia-qi1. Research on Identification of Wood Species by Mid-Infrared Spectroscopy Based on CA-SDP-DenseNet[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 814-822. |
| [12] |
HAI Jing-pu1, 2, GUO Ling-hua1, 2*, QI Yu-ying1, 2, LIU Guo-dong1, 2. Research on the Spectral Prediction Model of Gravure Spot Color Scale Based on Density[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 31-36. |
| [13] |
LENG Si-yu1, 2, QIAO Jia-hui1, WANG Lian-qing3, WANG Jun1, 2*, ZOU Liang1. Rapid Qualitative Analysis of Wool Content Based on Improved
U-Net++ and Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 303-309. |
| [14] |
FU Peng-you1, 2, WEN Yue2, ZHANG Yu-ke3, LI Ling-qiao1*, YANG Hui-hua1, 2*. Deep Learning Modelling and Model Transfer for Near-Infrared Spectroscopy Quantitative Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 310-319. |
| [15] |
CUI De-jian1, LIU Yang-yang1, XIA Yuan-tian1, JIA Wei-e1, LIAN Zheng-xing2, LI Lin1*. Non-Destructive Detection of Egg Fertilization Status Based on Hyperspectral Diffuse Reflectance[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3685-3691. |
|
|
|
|
