|
|
|
|
|
|
Spectral Reflectance Reconstruction Based on Camera Raw RGB Using Weighted Third-Order Polynomial and Wiener Estimation |
LI Fu-hao, LI Chang-jun* |
School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan 114051, China |
|
|
Abstract The research on predicting the spectral reflectance information of objects based on the camera RGB value has always attracted researchers’ attention. The traditional method is to restore spectral reflectance through the information under a single light source. Recently, Zhang et al. [Color Research & Application, 2017, 42: 68] proposed a two-step method for predicting reflectance based on camera RGB information under a single light source. Firstly, the camera response RGB value under a single light source is transformed to CIE XYZ values under different light sources through a polynomial model with local training samples using a pseudo-inverse method. Then the reflectance can be estimated based on the predicted CIE XYZ values under multiple light sources using local training samples and pseudo-inverse method. Though the method still uses camera RGB information under a single light source, obtaining CIE XYZ values under multiple illuminants improves the reconstruction accuracy of the spectral reflectance. Motivated by Zhang et al., a new two-step method is proposed for reconstructing spectral reflectance based on the raw camera RGB. Firstly, camera raw RGB is transformed to CIE tristimulus values under multi-illuminants via polynomial expansion of order 3 and weighted least square approach. Reflectance of the object is predicted based on the transformed CIE tristimulus values under multi-illuminants using the Wiener estimation. The prosed method uses the full set of training samples in order to avoid selecting a certain number of training samples that existed with the method of Zhang et al. Hence the proposed method is easy to be applied. Furthermore, in the method of Zhang et al., selected training samples are considered as equalimportant, while the proposed method assigns different weights to each of the training samples depending on the closeness to the given test sample in the first step so that prediction accuracy is increased. Comparison between the proposed method and the method given by Zhang et al. is considered. Both methods are trained using the X-Rite Color Checker Standard Digital (SG) chart and tested using the Color Checker Classic Chart and self-made 44 printed samples. Comparison results have shown that the proposed method outperforms the method given by Zhang et al. in terms of root mean square error (RMSE) and CIEDE2000 colour difference. Furthermore, the prediction accuracy of the proposed method is improved with the increase of the number of illuminants used, and the proposed method performs the best with 6 illuminants.
|
Received: 2020-10-12
Accepted: 2021-02-03
|
|
Corresponding Authors:
LI Chang-jun
E-mail: cjliustl@sina.com
|
|
[1] SI Zhan-jun, LI Yu, GU Chong(司占军, 李 煜, 顾 翀). Packaging Engineering(包装工程), 2013,(5): 98.
[2] YANG Ping, LIAO Ning-fang, Abed F M, et al(杨 萍, 廖宁放, Abed F M, 等). Optical Technique(光学技术), 2008, 34(6): 870, 876.
[3] CHEN Yi-yi, XU Hai-song, ZHANG Xian-dou, et al(陈奕艺, 徐海松, 张显斗, 等). Acta Optica Sinica(光学学报),2009,(5): 1416.
[4] Cao B,Liao N , Cheng H . Color Research & Application, 2016. 42(3), 327.
[5] Amiri M M, Fairchild M D. Color Research & Application, 2018, 43: 675.
[6] Liang J, Xiao K, Pointer M R, et al. Optics Express, 2019, 27(4): 5165.
[7] Zhang X, Wang Q, et al. Color Research & Application, 2017, 42: 68.
[8] LIANG Jin-xing, WAN Xiao-xia(梁金星, 万晓霞). Acta Optica Sinica(光学学报),2017,(9): 363.
[9] YIN Zhao, JIA Shang-hui(尹 钊, 贾尚晖). Mathematics in Practice and Theory(数学的实践与认识), 2009, 39(9): 239.
[10] LIANG Dong, ZHANG Lei-hong, LI Bei(梁 东, 张雷洪, 李 贝). Packaging Engineering(包装工程), 2016, 37(11): 164.
[11] WANG Li-mei, KONG Ling-jun(王丽梅, 孔玲君). Packaging Engineering(包装工程), 2015, (19): 125.
[12] Li C J, Luo M R, Wang G. Proc. of SPIE,2006,6033: 198.
[13] Li C J, Luo M R, Rigg B. Color Research & Application, 2010, 29(2): 91.
[14] Li C J, Luo M R, Melgosa M, et al. Color Research & Application, 2016, 41(2): 125. |
[1] |
JIANG Xiao-yu1, 2, LI Fu-sheng2*, WANG Qing-ya1, 2, LUO Jie3, HAO Jun1, 2, XU Mu-qiang1, 2. Determination of Lead and Arsenic in Soil Samples by X Fluorescence Spectrum Combined With CARS Variables Screening Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1535-1540. |
[2] |
LIU Mei-chen, XUE He-ru*, LIU Jiang-ping, DAI Rong-rong, HU Peng-wei, HUANG Qing, JIANG Xin-hua. Hyperspectral Analysis of Milk Protein Content Using SVM Optimized by Sparrow Search Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1601-1606. |
[3] |
JIANG Dan-yang1, WANG Zhi-feng1*, GAO Cheng1, 2, LI Chang-jun1. Spectral Reflectance Reconstruction With Color Constancy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1044-1048. |
[4] |
ZHU Wen-qiong, ZHOU Mu-chun*, ZHAO Qi, LIAO Jun. End-Point Prediction of BOF Steelmaking Based on Flame Spectral Feature Selection Using WCARS-ISPA[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(08): 2332-2336. |
[5] |
LU Hao-xiang1, ZHANG Jing2, LI Ling-qiao1*, LIU Zhen-bing1, YANG Hui-hua1,3, FENG Yan-chun4, YIN Li-hui4. Least Angle Regression Combined With Competitive Adaptive Re-Weighted Sampling for NIR Spectral Wavelength Selection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1782-1788. |
[6] |
ZHANG Feng1, TANG Xiao-jun1*, TONG Ang-xin1, WANG Bin1, TANG Chun-rui2, WANG Jie2. A Mid-Infrared Wavelength Selection Method Based on the Impact Value of Variables and Population Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1795-1799. |
[7] |
KANG Li1, 2, YUAN Jian-qing3, GAO Rui1, KONG Qing-ming1, JIA Yin-jiang1, SU Zhong-bin1*. Early Detection and Identification of Rice Blast Based on Hyperspectral Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(03): 898-902. |
[8] |
ZHOU Si-han1,2, HU Xin-yu1,2, TANG Bin1,2,3*, ZHAO Ming-fu1,2, LI Feng-xiao1,2, WANG Ren-jie1,2, XIAO Qi-sen1,2, XIAO Yu1,2. Application Research of Normalization Algorithm Based on EWMA-PCA in Standardization of Water Quality Spectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(11): 3443-3450. |
[9] |
SUN Zong-bao, WANG Tian-zhen, LIU Xiao-yu, ZOU Xiao-bo*, LIANG Li-ming, LI Jun-kui, NIU Zeng, GAO Yun-long. Detection of Prepared Steaks Freshness Using Hyperspectral Technology Combined With Wavelengths Selection Methods Combination Strategy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(10): 3224-3229. |
[10] |
BIAN Kai, ZHOU Meng-ran*, HU Feng, LAI Wen-hao, YAN Peng-cheng, SONG Hong-ping, DAI Rong-ying, HU Tian-yu. RF-CARS Combined with LIF Spectroscopy for Prediction and Assessment of Mine Water Inflow[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(07): 2170-2175. |
[11] |
WANG Yu-xi1, JIA Zhen-hong1*, YANG Jie2, Nikola K Kasabov3. A Variable Selection Method of the Selectivity Ratio Competitive Model Population Analysis for Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(04): 1056-1062. |
[12] |
CHEN Xiu-qing, YANG Qi, HAN Jing-ye, LIN Lin, SHI Liang-sheng*. Estimation of Winter Wheat Leaf Water Content Based on Leaf and Canopy Hyperspectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(03): 891-897. |
[13] |
WANG Yu-tian1, ZHANG Yan1*, SHANG Feng-kai1, ZHANG Jing-zhuo2, ZHANG Hui1, SUN Yang-yang1, WANG Xuan-rui1, WANG Shu-tao1. Three-Dimensional Fluorescence Combined with AWRCQLD to Measure Three Additives in Cosmetics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 501-505. |
[14] |
YUAN Zi-ran, WEI Li-fei*, ZHANG Yang-xi, YU Ming, YAN Xin-ru. Hyperspectral Inversion and Analysis of Heavy Metal Arsenic Content in Farmland Soil Based on Optimizing CARS Combined with PSO-SVM Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 567-573. |
[15] |
JIANG Xue-song1, MO Xin-xin3, SUN Tong2, 3*, HU Dong2. Determination of Trans Fatty Acids in Edible Vegetable Oil by Laser Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(12): 3821-3825. |
|
|
|
|