|
|
|
|
|
|
Application of Different Smoothing Ensemble CARS Algorithm in Spectral Discrimination of Black Tea Grade |
YUAN Li, SHI Bin, YU Jian-cheng, TANG Tian-yu, YUAN Yuan, TANG Yan-lin* |
School of Physics, Guizhou University, Guiyang 550025, China |
|
|
Abstract Moving window smoothing ensemble CARS (MWS-ECARS) is a stable algorithm for extracting characteristic variables. Based on the previous studies, two improved MWS-ECARS are proposed to reduce the dimension of black tea spectrum based on different window smoothing algorithms in this paper, and compared with the original MWS-ECARS, the commonly used successive projections algorithm (SPA), the competitive adaptive reweighting algorithm (CARS) and the moving window partial least squares method (MWPLS). A partial least square regression model (PLSR) was established to select the best black tea grade discrimination model. Two improved MWS-ECARS methods are Gaussian filter ECARS (GF-ECARS) and Median filter smoothing ECARS (MF-ECARS), respectively. The CARS algorithm runs n times (n=1 000 in this paper). The wavelength and its corresponding selected frequency are sorted out and different window smoothing algorithms are used to smooth the selection frequency. The window widths are all 3~31, and the window step sizes are all 2. The threshold is set through the selection frequency smoothed by different window widths and smoothing algorithm, and the starting threshold and step size are both 20. Finally, the wavelength whose selection frequency is higher than the threshold is selected and the PLSR model is established. The correlation coefficient of prediction set (R2p) is taken as the judgment factor. The closer R2p is to 1, the more accurate the established model is. The results show that the black tea grade discrimination model established by the extracted characteristic variables with the improved GF-ECARS algorithm is the best. The R2p reaches 0.969 2. The reason is that the amplitude difference of each point on the curve will become smaller in the window Gaussian filtering smoothing algorithm as the window width increases. In the weighted average process of Gaussian algorithm, it is not easy to associate the low frequency wavelength with the high weight. In practical applications, the selection frequency of effective band is often low, which can be smoothed by selecting a Gaussian filter with narrow window width. In addition, due to the characteristics of the Gaussian curve, the Gaussian filtering algorithm can well protect the details of the window edge image. Although the modeling result of the MF-ECARS algorithm is slightly worse than the original MWS-ECARS, its R2p still reaches over 0.96. This shows that the improved algorithm can improve the prediction ability of the original model. MWS-ECARS extraction feature variables are different based on different window smoothing algorithms. However, as the smoothing window width increases, the continuity of the extracted characteristic variables is enhanced and the number of extracted characteristic variables is reduced. The R2p of the three MWS-ECARS algorithms all show that they are more effective and stable than the commonly SPA, CARS and MWPRS algorithms. This study can provide ideas for selective dimensionality reduction of spectral data.
|
Received: 2019-08-22
Accepted: 2019-12-26
|
|
Corresponding Authors:
TANG Yan-lin
E-mail: tylgzu@163.com
|
|
[1] SONG Xiang-zhong, XIONG Yan-mei, ZHANG Lu-da, et al(宋相中, 熊艳梅, 张录达, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2016, 36(S1): 181.
[2] Omar J, Slowikowski B, Boix A. Forensic Science International, 2019, 294: 15.
[3] Leqian H, Chunling Y, Shuai M, et al. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 2018, 205: 574.
[4] Dong C, Zhu H, Wang J, et al. Food Science and Biotechnology, 2017, 26(4): 853.
[5] Song J, Li G, Yang X. J. Sci. Food Agric., 2019, 9: 4898.
[6] Li D X, Wang H, Wan X C. China Tea Scienc Society, 2005: 13.
[7] Singh B N, Prateeksha, Rawat A K S, et al. Critical Reviews in Food Science and Nutrition, 2017, 57(7): 1394.
[8] Dey A, Gomes A, Dasgupta S C. Pharmacognosy Magazine, 2017, 13(52): S769.
[9] Ji H Y, Dong X D, Yu S S, et al. Journal of Food Measurement and Characterization, 2019, 13: 1620.
[10] Lantano C, Rinaldi M, Cavazza A. Journal of Food Science and Technology, 2015, 52(12): 8276.
[11] Dash I, Bhaskar D, Bhawsar H, Sahoo M. Bioresource Technology Reports, 2018, 4: 209.
[12] CHEN Yue-yang, GAO Zhi-shan, YU Xiao-hui, et al(陈玥洋, 高志山, 郁晓晖, 等). Journal of Applied Optics(应用光学), 2017, 38(1): 99.
[13] Wang S H, Zhao Y, Hu R, et al. Chinese Journal of Analytical Chemistry, 2019, 47(4): e19034. |
[1] |
YANG Qun1, 2, LING Qi-han1, WEI Yong1, NING Qiang1, 2, KONG Fa-ming1, ZHOU Yi-fan1, 2, ZHANG Hai-lin1, WANG Jie1, 2*. Non-Destructive Monitoring Model of Functional Nitrogen Content in
Citrus Leaves Based on Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3396-3403. |
[2] |
TANG Ruo-han1, 2, LI Xiu-hua1, 2*, LÜ Xue-gang1, 2, ZHANG Mu-qing2, 3, YAO Wei2, 3. Transmittance Vis-NIR Spectroscopy for Detecting Fibre Content of
Living Sugarcane[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2419-2425. |
[3] |
JING Yi-xuan1, WU Di2, LIU Gui-shan2*, HE Jian-guo2*, YANG Shi-hu2, MA Ping2, SUN Yuan-yuan2. Fusion of Near-Infrared Hyperspectral Imaging (NIR-HSI) and Texture Feature for Discrimination of Lingwu Long Jujube With Different Bruise Grades[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2644-2648. |
[4] |
LUO Zheng-fei1, GONG Zheng-li1, 2, YANG Jian1, 2*, YANG Chong-shan2, 3, DONG Chun-wang3*. Rapid Non-Destructive Detection Method for Black Tea With Exogenous Sucrose Based on Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2649-2656. |
[5] |
LIN Jing-tao, XIN Chen-xing, LI Yan*. Spectral Characteristics of “Trapiche-Like Sapphire” From ChangLe, Shandong Province[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1199-1204. |
[6] |
DENG Xiao-jun1, 2, MA Jin-ge1, YANG Qiao-ling3, SHI Yi-yin1, HUO Yi-hui1, GU Shu-qing1, GUO De-hua1, DING Tao4, YU Yong-ai5, ZHANG Feng6. Visualized Fast Identification Method of Imported Olive Oil Quality Grade Based on Raman-UV-Visible Fusion Spectroscopy Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1117-1125. |
[7] |
YUE Kong, LU Dong, SONG Xue-song. Influence of Thermal Modification on Poplar Strength Class by Fourier Infrared Spectroscopy Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 848-853. |
[8] |
MAO Xiao-tian1, CHEN Chang2, YIN Zuo-wei1*, WANG Zi-min1. Spectra Characterization of Cr-Grossular (Tsavorite) With “Frogspawn” Color Zoning From Canada[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 520-525. |
[9] |
BAO Pei-jin1, CHEN Quan-li1, 2*, WU Yan-han1, LI Xuan1, ZHAO An-di1. Spectroscopy Characteristics of Emerald From Swat Valley, Pakistan[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 213-219. |
[10] |
OUYANG Ai-guo, YU Bin, HU Jun, LIN Tong-zheng, LIU Yan-de. Grade Evaluation of Grain Size in High-Speed Railway Wheel Steel Based on Laser-Induced Breakdown Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3428-3434. |
[11] |
HU Guo-tian1, 2, 3, SHANG Hui-wei1, 2, 3, TAN Rui-hong1, XU Xiang-hu1, PAN Wei-dong1. Research on Model Transfer Method of Organic Matter Content
Estimation of Different Soils Using VNIR Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3148-3154. |
[12] |
ZHANG Fu1, 2, 3, WANG Xin-yue2, CUI Xia-hua2, CAO Wei-hua2, ZHANG Xiao-dong1*, ZHANG Ya-kun2. Classification of Qianxi Tomatoes by Visible/Near Infrared Spectroscopy Combined With GMO-SVM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3291-3297. |
[13] |
LI Rui1, LI Bo1*, WANG Xue-wen1, LIU Tao1, LI Lian-jie1,2, FAN Shu-xiang2. A Classification Method of Coal and Gangue Based on XGBoost and
Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(09): 2947-2955. |
[14] |
ZHONG Xiang-jun1, 2, YANG Li1, 2*, ZHANG Dong-xing1, 2, CUI Tao1, 2, HE Xian-tao1, 2, DU Zhao-hui1, 2. Effect of Different Particle Sizes on the Prediction of Soil Organic Matter Content by Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(08): 2542-2550. |
[15] |
LI Xue-ying1, 2, LI Zong-min3*, CHEN Guang-yuan4, QIU Hui-min2, HOU Guang-li2, FAN Ping-ping2*. Prediction of Tidal Flat Sediment Moisture Content Based on Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1156-1161. |
|
|
|
|