|
|
|
|
|
|
Near-Infrared Spectral Modeling Based on Stacked Supervised Auto-Encoder |
SUN Zhi-xing, ZHAO Zhong-gai*, LIU Fei |
Key Laboratory for Advanced Process Control of Light Industry of the Ministry of Education, Jiangnan University, Wuxi 214122, China
|
|
|
Abstract The near-infrared spectrum contains the characteristic information of the hydrogen-containing groups of organic molecules in the substance, and it has the characteristics of high dimensionality and large redundancy. Traditional near-infrared spectroscopy techniques are based on shallow correction models, such as principal component regression, partial least squares regression, artificial neural networks, support vector regression etc., which cannot extract the deep information of the spectral data. This paper proposes a near-infrared spectroscopy modeling method based on stacked supervised autoencoders, which can fit the complex non-linear relationship between spectral data and target physicochemical values and extract the deep feature information of the data. First, the optimal preprocessing method is selected by comparing the effects of different spectral preprocessing on the model prediction results. Then the correlation coefficient method is used to extract the characteristic bands of the preprocessed spectrum. The method uses the processed near-infrared spectrum data as the input signal. Then use the target physicochemical values to perform supervised pre-training on multiple supervised autoencoders, and stack multiple pre-trained supervised autoencoders. The stacked supervised autoencoder is obtained, the pre-trained parameters are used as the initialization parameters of the stacked supervised autoencoder, and then the target physicochemical values are used to supervise and fine-tune the stacked supervised autoencoder. Finally the optimal parameters of the model are obtained. Established partial least squares regression prediction model, artificial neural networks prediction model, stack auto-encoder prediction model and stack supervised auto-encoder prediction model on the corn water content data and the total acid content data of yellow wine respectively, verifying the feasibility of stack supervised auto-encoder modeling. The root means square error and residual prediction deviation are employed to evaluate model performance. The accuracy of four modeling methods of partial least squares regression, backpropagation- artificial neural networks, stack auto-encoder, and stack supervised auto-encoder are compared and analyzed. The analysis results show that the model established by stack supervised auto-encoder has a good prediction effect. The two evaluation indexes of the corn water content data set reached 0.061 1 and 4.271; the two evaluation indexes of rice wine’s total acid content data reached 0.126 6 and 4.006, excellent for the other three methods.
|
Received: 2021-02-10
Accepted: 2021-04-09
|
|
Corresponding Authors:
ZHAO Zhong-gai
E-mail: gaizihao@jiangnan.edu.cn
|
|
[1] YAN Yan-lu(严衍禄). Basic and Application pf Near Infrared Spectroscopy Analysis(近红外光谱分析与应用). Beijing: Chinese Light Industry Press(北京: 中国轻工业出版社), 2005.
[2] Joscelin T D, Matthew W V, Mari S C. Industrial Crops and Products, 2014, 59: 119.
[3] Antonios M, Xanthoula-Eirini P, Dimitrios M, et al. Biosystems Engineering, 2016, 152: 104.
[4] Sophia Mayr, Krzysztof B Bec, Justyna Grabska, et al. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 2021, 249: 1386.
[5] Balabin R M, Lomakina E I, Safieva R Z. Fuel, 2011, 90(5): 2007.
[6] Hu Baotian, Lu Zhengdong, Li Hang, et al. Advances in Neural Information Processing Systems, 2014, 3: 2042.
[7] Lecun Y, Bengio Y, Hinton G. Nature, 2015, 521(7553): 436.
[8] Yu J B, Yan X F. Industrial and Engineering Chemistry Research, 2018, 57(45): 15479.
[9] Lyu Y T, Chen J H, Song Z H. Chemometrics and Intelligent Laboratory Systems, 2019, 189: 8.
[10] Zhang Zhanpeng, Luo Ping, Chen C L, et al. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(5): 918.
[11] ZHANG Wei-dong, LI Ling-qiao, HU Jin-quan, et al(张卫东, 李灵巧, 胡锦泉, 等). Chinese Journal of Analytical Chemistry(分析化学), 2018, 46(9): 1446.
[12] LU Hao-xiang, WEI Man-man, YANG Hui-hua, et al(路皓翔, 魏曼曼, 杨辉华, 等). Laser and Infrared(激光与红外), 2019, 49(4): 460.
[13] Yang Huihua, Hu Baichao, Pan Xipeng, et al. Journal of Innovative Optical Health Sciences, 2017, 10(2): 1630011.
[14] CHEN Ling-yi, ZHAO Zhong-gai, LIU Fei(陈令奕, 赵忠盖, 刘 飞). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2017, 37(11): 3414.
[15] Roberto K H G, Mário C U A, Gledson E J, et al. Talanta, 2005, 67(4): 736.
[16] Yang Z Y, Ge Z Q. Journal Process Control, 2020, 92: 19.
[17] Lei L, Patterson A, White M. Supervised Autoencoders: Improving Generalization Performance With Unsupervised Regularizers, Proceedings of the 32nd International Conference on Neural Information Processing Systems, 2018. 107.
[18] Malley D F, Rönicke H, Findlay D L, et al. Journal of Paleolimnology, 1999, 21(3): 295.
|
[1] |
SHI Wen-qiang1, XU Xiu-ying1*, ZHANG Wei1, ZHANG Ping2, SUN Hai-tian1, 3, HU Jun1. Prediction Model of Soil Moisture Content in Northern Cold Region Based on Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1704-1710. |
[2] |
WANG Xue-pei1, 2, ZHANG Lu-wei1, 2, BAI Xue-bing3, MO Xian-bin1, ZHANG Xiao-shuan1, 2*. Infrared Spectral Characterization of Ultraviolet Ozone Treatment on Substrate Surface for Flexible Electronics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1867-1873. |
[3] |
WANG Yue1, 3, 4, CHEN Nan1, 2, 3, 4, WANG Bo-yu1, 5, LIU Tao1, 3, 4*, XIA Yang1, 2, 3, 4*. Fourier Transform Near-Infrared Spectral System Based on Laser-Driven Plasma Light Source[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1666-1673. |
[4] |
FENG Rui-jie1, CHEN Zheng-guang1, 2*, YI Shu-juan3. Identification of Corn Varieties Based on Bayesian Optimization SVM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1698-1703. |
[5] |
YU Zhi-rong, HONG Ming-jian*. Near-Infrared Spectral Quantitative Analysis Network Based on Grouped Fully Connection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1735-1740. |
[6] |
MENG Fan-jia1, LUO Shi1, WU Yue-feng1, SUN Hong1, LIU Fei2, LI Min-zan1*, HUANG Wei3, LI Mu3. Characteristic Extraction Method and Discriminant Model of Ear Rot of Maize Seed Base on NIR Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1716-1720. |
[7] |
PENG Yan-fang1, WANG Jun1, WU Zhi-sheng2*, LIU Xiao-na3, QIAO Yan-jiang2*. NIR Band Assignment of Tanshinone ⅡA and Cryptotanshinone by
2D-COS Technology and Model Application Tanshinone Extract[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1781-1785. |
[8] |
ZHANG Shuai-shuai1, GUO Jun-hua1, LIU Hua-dong1, ZHANG Ying-li1, XIAO Xiang-guo2, LIANG Hai-feng1*. Design of Subwavelength Narrow Band Notch Filter Based on
Depth Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1393-1399. |
[9] |
WANG Li-qi1, YAO Jing1, WANG Rui-ying1, CHEN Ying-shu1, LUO Shu-nian2, WANG Wei-ning2, ZHANG Yan-rong1*. Research on Detection of Soybean Meal Quality by NIR Based on
PLS-GRNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1433-1438. |
[10] |
FU Yan-hua1, LIU Jing2*, MAO Ya-chun2, CAO Wang2, HUANG Jia-qi2, ZHAO Zhan-guo3. Experimental Study on Quantitative Inversion Model of Heavy Metals in Soda Saline-Alkali Soil Based on RBF Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1595-1600. |
[11] |
ZHANG Xiao-hong1, JIANG Xue-song1*, SHEN Fei2*, JIANG Hong-zhe1, ZHOU Hong-ping1, HE Xue-ming2, JIANG Dian-cheng1, ZHANG Yi3. Design of Portable Flour Quality Safety Detector Based on Diffuse
Transmission Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1235-1242. |
[12] |
ZHENG Kai-yi1, ZHANG Wen1, DING Fu-yuan1, ZHOU Chen-guang1, SHI Ji-yong1, Yoshinori Marunaka2, ZOU Xiao-bo1*. Using Ensemble Refinement (ER) Method to OptimizeTransfer Set of Near-Infrared Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1323-1328. |
[13] |
LI Jia-yi1, YU Mei1, LI Mai-quan1, ZHENG Yu2*, LI Pao1, 3*. Nondestructive Identification of Different Chrysanthemum Varieties Based on Near-Infrared Spectroscopy and Pattern Recognition Methods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1129-1133. |
[14] |
CHEN Chu-han1, ZHONG Yang-sheng2, WANG Xian-yan3, ZHAO Yi-kun1, DAI Fen1*. Feature Selection Algorithm for Identification of Male and Female
Cocoons Based on SVM Bootstrapping Re-Weighted Sampling[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1173-1178. |
[15] |
LI Xue-ying1, 2, LI Zong-min3*, CHEN Guang-yuan4, QIU Hui-min2, HOU Guang-li2, FAN Ping-ping2*. Prediction of Tidal Flat Sediment Moisture Content Based on Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1156-1161. |
|
|
|
|