|
|
|
|
|
|
Spectral Reflectance Reconstruction Based on Camera Raw RGB Using Weighted Third-Order Polynomial and Wiener Estimation |
LI Fu-hao, LI Chang-jun* |
School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan 114051, China |
|
|
Abstract The research on predicting the spectral reflectance information of objects based on the camera RGB value has always attracted researchers’ attention. The traditional method is to restore spectral reflectance through the information under a single light source. Recently, Zhang et al. [Color Research & Application, 2017, 42: 68] proposed a two-step method for predicting reflectance based on camera RGB information under a single light source. Firstly, the camera response RGB value under a single light source is transformed to CIE XYZ values under different light sources through a polynomial model with local training samples using a pseudo-inverse method. Then the reflectance can be estimated based on the predicted CIE XYZ values under multiple light sources using local training samples and pseudo-inverse method. Though the method still uses camera RGB information under a single light source, obtaining CIE XYZ values under multiple illuminants improves the reconstruction accuracy of the spectral reflectance. Motivated by Zhang et al., a new two-step method is proposed for reconstructing spectral reflectance based on the raw camera RGB. Firstly, camera raw RGB is transformed to CIE tristimulus values under multi-illuminants via polynomial expansion of order 3 and weighted least square approach. Reflectance of the object is predicted based on the transformed CIE tristimulus values under multi-illuminants using the Wiener estimation. The prosed method uses the full set of training samples in order to avoid selecting a certain number of training samples that existed with the method of Zhang et al. Hence the proposed method is easy to be applied. Furthermore, in the method of Zhang et al., selected training samples are considered as equalimportant, while the proposed method assigns different weights to each of the training samples depending on the closeness to the given test sample in the first step so that prediction accuracy is increased. Comparison between the proposed method and the method given by Zhang et al. is considered. Both methods are trained using the X-Rite Color Checker Standard Digital (SG) chart and tested using the Color Checker Classic Chart and self-made 44 printed samples. Comparison results have shown that the proposed method outperforms the method given by Zhang et al. in terms of root mean square error (RMSE) and CIEDE2000 colour difference. Furthermore, the prediction accuracy of the proposed method is improved with the increase of the number of illuminants used, and the proposed method performs the best with 6 illuminants.
|
Received: 2020-10-12
Accepted: 2021-02-03
|
|
Corresponding Authors:
LI Chang-jun
E-mail: cjliustl@sina.com
|
|
[1] SI Zhan-jun, LI Yu, GU Chong(司占军, 李 煜, 顾 翀). Packaging Engineering(包装工程), 2013,(5): 98.
[2] YANG Ping, LIAO Ning-fang, Abed F M, et al(杨 萍, 廖宁放, Abed F M, 等). Optical Technique(光学技术), 2008, 34(6): 870, 876.
[3] CHEN Yi-yi, XU Hai-song, ZHANG Xian-dou, et al(陈奕艺, 徐海松, 张显斗, 等). Acta Optica Sinica(光学学报),2009,(5): 1416.
[4] Cao B,Liao N , Cheng H . Color Research & Application, 2016. 42(3), 327.
[5] Amiri M M, Fairchild M D. Color Research & Application, 2018, 43: 675.
[6] Liang J, Xiao K, Pointer M R, et al. Optics Express, 2019, 27(4): 5165.
[7] Zhang X, Wang Q, et al. Color Research & Application, 2017, 42: 68.
[8] LIANG Jin-xing, WAN Xiao-xia(梁金星, 万晓霞). Acta Optica Sinica(光学学报),2017,(9): 363.
[9] YIN Zhao, JIA Shang-hui(尹 钊, 贾尚晖). Mathematics in Practice and Theory(数学的实践与认识), 2009, 39(9): 239.
[10] LIANG Dong, ZHANG Lei-hong, LI Bei(梁 东, 张雷洪, 李 贝). Packaging Engineering(包装工程), 2016, 37(11): 164.
[11] WANG Li-mei, KONG Ling-jun(王丽梅, 孔玲君). Packaging Engineering(包装工程), 2015, (19): 125.
[12] Li C J, Luo M R, Wang G. Proc. of SPIE,2006,6033: 198.
[13] Li C J, Luo M R, Rigg B. Color Research & Application, 2010, 29(2): 91.
[14] Li C J, Luo M R, Melgosa M, et al. Color Research & Application, 2016, 41(2): 125. |
[1] |
CHENG Hui-zhu1, 2, YANG Wan-qi1, 2, LI Fu-sheng1, 2*, MA Qian1, 2, ZHAO Yan-chun1, 2. Genetic Algorithm Optimized BP Neural Network for Quantitative
Analysis of Soil Heavy Metals in XRF[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3742-3746. |
[2] |
MA Yuan, LI Ri-hao, ZHANG Wei-feng*. Research on the Training Samples Selection for Spectral Reflectance
Reconstruction Based on Improved Weighted Euclidean Distance[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3924-3929. |
[3] |
LÜ Cong1, LI Chang-jun1, SUN Hong-yan1, GAO Cheng1, 2*. A New Interim Connection Space MLabPQR for Spectral Image
Compression and Reconstruction[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3347-3350. |
[4] |
AN Bai-song1, 2, WANG Xue-mei1, 2*, HUANG Xiao-yu1, 2, KAWUQIATI Bai-shan1, 2. Hyperspectral Estimation of Soil Lead Content Based on Random Frog Band Selection Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 3302-3309. |
[5] |
WU Yong-qing1, 2, TANG Na1, HUANG Lu-yao1, CUI Yu-tong1, ZHANG Bo1, GUO Bo-li1, ZHANG Ying-quan1*. Model Construction for Detecting Water Absorption in Wheat Flour Using Vis-NIR Spectroscopy and Combined With Multivariate Statistical #br#
Analyses[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2825-2831. |
[6] |
ZHU Yan-ping1, CUI Chuan-jin1*, CHENG Peng-fei1, 2, PAN Jin-yan1, SU Hao1, 2, ZHANG Yi1. Measurement of Oil Pollutants by Three-Dimensional Fluorescence
Spectroscopy Combined With BP Neural Network and SWATLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2467-2475. |
[7] |
LIU Yong1, ZHANG Jiang2, XIONG Cen-bo3*, DONG Yi3*, JI Wen-long4, XU Feng4, SHEN Jian2. Residual Life Prediction of Wet Clutch Based on Oil Spectrum Data
Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1314-1319. |
[8] |
ZHANG Fu1, 2, 3, CAO Wei-hua1, CUI Xia-hua1, WANG Xin-yue1, FU San-ling4*, ZHANG Ya-kun1. Non-Destructive Detection of Soluble Solids in Cherry Tomatoes by
Visible/Near Infrared Spectroscopy Based on SG-CARS-IBP[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 737-743. |
[9] |
ZHONG Xiang-jun1,2, YANG Li1,2*, ZHANG Dong-xing1,2, CUI Tao1,2, HE Xian-tao1,2, DU Zhao-hui1,2. Prediction of Organic Matter Content in Sandy Fluvo-Aquic Soil by
Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(09): 2924-2930. |
[10] |
JIANG Wan-li1, 2, SHI Jun-sheng1, 2*, JI Ming-jiang1, 2. Establishment of Visible and NIR Spectral Reflectance Database of Plant Leaves and Principal Component Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(08): 2366-2373. |
[11] |
ZHONG Xiang-jun1, 2, YANG Li1, 2*, ZHANG Dong-xing1, 2, CUI Tao1, 2, HE Xian-tao1, 2, DU Zhao-hui1, 2. Effect of Different Particle Sizes on the Prediction of Soil Organic Matter Content by Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(08): 2542-2550. |
[12] |
JIANG Xiao-yu1, 2, LI Fu-sheng2*, WANG Qing-ya1, 2, LUO Jie3, HAO Jun1, 2, XU Mu-qiang1, 2. Determination of Lead and Arsenic in Soil Samples by X Fluorescence Spectrum Combined With CARS Variables Screening Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1535-1540. |
[13] |
LIU Mei-chen, XUE He-ru*, LIU Jiang-ping, DAI Rong-rong, HU Peng-wei, HUANG Qing, JIANG Xin-hua. Hyperspectral Analysis of Milk Protein Content Using SVM Optimized by Sparrow Search Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1601-1606. |
[14] |
JIANG Dan-yang1, WANG Zhi-feng1*, GAO Cheng1, 2, LI Chang-jun1. Spectral Reflectance Reconstruction With Color Constancy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1044-1048. |
[15] |
ZHU Wen-qiong, ZHOU Mu-chun*, ZHAO Qi, LIAO Jun. End-Point Prediction of BOF Steelmaking Based on Flame Spectral Feature Selection Using WCARS-ISPA[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(08): 2332-2336. |
|
|
|
|