|
|
|
|
|
|
A Variable Selection Approach of Near Infrared Spectra Based on Window Competitive Adaptive Reweighted Sampling Strategy |
LI Pao1, ZHOU Jun2, JIANG Li-wen1, LIU Xia1, DU Guo-rong1,2* |
1. College of Food Science and Technology, Hunan Agricultural University, Changsha 410128, China
2. Beijing Work Station, Technology Center, Shanghai Tobacco Group Co., Ltd., Beijing 101121, China |
|
|
Abstract Variable selection plays an important role in the quantitative analysis of near infrared spectra. The accuracy of near infrared spectroscopy can be improved by eliminating the redundant variables and selecting the characteristic variables. Competitive adaptive reweighted sampling (CARS) method is a newly developed strategy for wavelength selection by employing the principle “survival of the fittest” on which Darwin’s Evolution Theory is based. The number of selected wavelengths by CARS is much smaller than those of other methods with fast calculating speed and high accuracy. However, it is easy to get inconsistent results between the calibration and validation set due to the excessive attention on the cross validation results. In order to develop a robust variable selection method, by combining the advantages of CARS and “window”, a new tactic called window competitive adaptive reweighted sampling (WCARS) is employed to select characteristic variables and applied to the analysis of the near infrared spectra of the complex plant samples and the contents of the chemical components. Compared with the results of CARS method, accurate quantitative results can be obtained by the WCARS method. Furthermore, the results of correction set are consistent with those of the prediction set, and the problem of overfitting can be avoided. The results show that WCARS tactic can efficiently improve the accuracy and stability of variables selection and optimize the precision of prediction model, which has a certain application value.
|
Received: 2018-03-06
Accepted: 2018-07-26
|
|
Corresponding Authors:
DU Guo-rong
E-mail: nkchem09@mail.nankai.edu.cn
|
|
[1] ZHANG Yi-ting, WANG Cui-cui, FAN Meng-li, et al(张伊挺,王翠翠,樊梦丽,等). Spectroscopy and Spectral Analysis (光谱学与光谱分析), 2017, 36(12): 4100.
[2] Wang C C, Cai W S, Shao X G. Analytical Letters, 2017, 51(4): 537.
[3] Wei H Y, Li H, Liu P, et al. Spectroscopy Letters, 2017, 50(7): 470.
[4] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立,袁洪福,陆婉珍). Progress Chemistry(化学进展), 2004, 16(4): 528.
[5] Tan Z, Lou T T, Huang Z X, et al. Journal of Agricultural and Food Chemistry, 2017, 65: 6274.
[6] Han X, Huang Z X, Chen X D, et al. Fuel, 2017, 207: 146.
[7] Zhang C X, Bian X H, Liu P, et al. Chemometrics and Intelligent Laboratory Systems, 2016, 161: 43.
[8] Saudland A, Wagner J, Nielsen J P, et al. Applied Spectroscopy, 2007, 54(3): 413.
[9] Ranzan C, Trierweiler L F, Hitzmann B, et al. Chemometrics and Intelligent Laboratory Systems, 2015, 142: 78.
[10] Li H D, Liang Y Z, Xu Q S, et al. Analytica Chimica Acta, 2009, 648(1): 77.
[11] Cai W S, Li Y K, Shao X G. Chemometrics and Intelligent Laboratory Systems, 2008, 90(2): 188.
[12] Xu H, Liu Z C, Cai W S, et al. Chemometrics and Intelligent Laboratory Systems, 2009, 97(2): 189.
[13] Han X, Tan Z, Huang Z X, et al. Analytical Methods 2017, 9: 3720.
[14] Nie L X, Dai Z, Ma S C. Analytical Letters, 2016, 49(14): 2259.
[15] Wu L J, Wang B X, Yin Y F, et al. Analytical Letters, 2016, 49(14): 2290.
[16] Li H D, Xu Q S, Liang Y Z. Chemometrics and Intelligent Laboratory Systems, 2018, 176: 34. |
[1] |
GAO Feng1, 2, XING Ya-ge3, 4, LUO Hua-ping1, 2, ZHANG Yuan-hua3, 4, GUO Ling3, 4*. Nondestructive Identification of Apricot Varieties Based on Visible/Near Infrared Spectroscopy and Chemometrics Methods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 44-51. |
[2] |
CHU Bing-quan1, 2, LI Cheng-feng1, DING Li3, GUO Zheng-yan1, WANG Shi-yu1, SUN Wei-jie1, JIN Wei-yi1, HE Yong2*. Nondestructive and Rapid Determination of Carbohydrate and Protein in T. obliquus Based on Hyperspectral Imaging Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3732-3741. |
[3] |
ZHANG Shu-fang1, LEI Lei2, LEI Shun-xin2, TAN Xue-cai1, LIU Shao-gang1, YAN Jun1*. Traceability of Geographical Origin of Jasmine Based on Near
Infrared Diffuse Reflectance Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3389-3395. |
[4] |
WANG Dong1, 2, FENG Hai-zhi3, LI Long3, HAN Ping1, 2*. Compare of the Quantitative Models of SSC in Tomato by Two Types of NIR Spectrometers[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(05): 1351-1357. |
[5] |
SU Ling1, 2, BU Ya-ping1, 2, LI Yuan-yuan2, WANG Qi1, 2*. Study on the Prediction Method of Pleurotus Ostreatus Protein and
Polysaccharide Content Based on Fourier Transform Infrared
Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1262-1267. |
[6] |
WU Cheng-zhao1, WANG Yi-tao1, HU Dong1, SUN Tong1, 2*. Research Progress of Near-Infrared Spectroscopy in the Detection of
Edible Oil Adulteration[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 685-691. |
[7] |
LI Zi-yi1, LI Rui-lan1, LI Can-lin1, WANG Ke-ru2, FAN Jiu-yu3, GU Rui1*. Identification of Tibetan Medicine Zhaxun by Infrared Spectroscopy
Combined With Chemometrics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 526-532. |
[8] |
XIE Ying-ke1, 2, WANG Xi-chen2, LIANG Heng-heng2, WEN Quan3. A Near-Infrared Micro-Spectrometer Based on Integrated Scanning
Grating Mirror and Improved Asymmetric C-T Structure[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 563-568. |
[9] |
DONG Xin-xin, YANG Fang-wei, YU Hang, YAO Wei-rong, XIE Yun-fei*. Study on Rapid Nondestructive Detection of Pork Lean Freshness Based on Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 484-488. |
[10] |
LI Yue1, LIU Gui-shan1*, FAN Nai-yun1*, HE Jian-guo1, LI Yan1, SUN You-rui1, PU Fang-ning2. A Combination of Hyperspectral Imaging With Two-Dimensional Correlation Spectroscopy for Monitoring the Hemicellulose Content in Lingwu Long Jujube[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3935-3940. |
[11] |
CHEN Wei1, WU Hai-long1*, WANG Tong1*, CHANG Yue-yue1, CHEN Yao2, YANG Jian3, FU Hai-yan4, YANG Xiao-long4, LI Xu-fu5, YU Ru-qin1. Origin Traceability of Atractylodes Macrocephala Koidz. by Using Three-Way Fluorescence Coupled With Chemometrics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(09): 2875-2883. |
[12] |
LÜ Ru-lin1, HE Hong-yuan1*, JIA Zhen1, WANG Shu-yue1, CAI Neng-bin2, WANG Xiao-bin1. Application Progress of Spectral Detection Technology of Melamine
in Food[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 1999-2006. |
[13] |
YANG Lin-yu1, 2, 3, DING Yu1, 2, 3*, ZHAN Ye4, ZHU Shao-nong1, 2, 3, CHEN Yu-juan1, 2, 3, DENG Fan1, 2, 3, ZHAO Xing-qiang1, 2, 3. Quantitative Analysis of Mn and Ni Elements in Steel Based on LIBS and GA-PLS[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1804-1808. |
[14] |
LI Jia-yi1, YU Mei1, LI Mai-quan1, ZHENG Yu2*, LI Pao1, 3*. Nondestructive Identification of Different Chrysanthemum Varieties Based on Near-Infrared Spectroscopy and Pattern Recognition Methods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1129-1133. |
[15] |
SUN Xue-hui1, ZHAO Bing2, LUO Zhen2, SUN Pei-jian1, PENG Bin1, NIE Cong1*, SHAO Xue-guang3*. Design and Application of the Discrimination Filter for Near-Infrared Spectroscopic Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 399-404. |
|
|
|
|