|
|
|
|
|
|
Study on the Predication Modeling of COD for Water Based on UV-VIS Spectroscopy and CNN Algorithm of Deep Learning |
JIA Wen-shen1,2,4,5, ZHANG Heng-zhi2, MA Jie2, LIANG Gang1,4,5, WANG Ji-hua1,4,5, LIU Xin3* |
1. Beijing Research Center of Agricultural Standards and Testing,Beijing 100097,China
2. Beijing Information Science and Technology University,Beijing 100192,China
3. Technical Center,Beijing Customs District, Beijing 100026,China
4. Department of Risk Assessment Lab for Agro-products,Beijing 100097,China
5. Key Laboratory of Urban Agriculture (North China), Ministry of Agriculture and Rural Affairs, Beijing 100097, China |
|
|
Abstract Water is vital for human life, and the quality of water is directly related to people’s quality of life. At present, research into chemical oxygen demand (COD) methods for determining water quality is mainly focused on spectral data preprocessing and spectral feature extraction, with few studies considering spectral data modeling methods. Convolutional neural networks (CNN) are known to have strong feature extraction and feature mapping abilities. Thus, in this study, a CNN is combined with UV-visible spectroscopy to establish a COD prediction model. The Savitzky-Golay smoothing filter is applied to remove noise interference, and the spectral data are then input to the CNN model. The features of the spectrum data are extracted through the convolution layer, the spatial dimensions are reduced in the pooling layer, and the global features are mapped in the fully connected layer. The model is trained using the ReLU activation function and the Adam optimizer. A series of experiments show that the CNN model has a strong ability to predict COD in water, with a high prediction accuracy and good fit to the regression curve. A comparison with other models indicates that the proposed CNN model gives the smallest RMSEP and MAE, the largest -R2, and the best fitting effect. It is found that the model has strong generalization ability through the evaluation effect of the training samples. To counter the inaccuracy of the predicted results caused by the peak shift of the absorption spectrum, a regression model based on a strengthened CNN (CNNs) is also developed. After denoising, the spectral data can be divided into three categories according to the different characteristics of absorption peaks, and the corresponding CNN regression model is input respectively for prediction. When the corresponding regression model is applied, the experimental results show that the sectional CNNs model outperforms our original CNN model in terms of fitting, prediction precision, determination coefficient, and error. Not only does R2 increase significantly, reaching 0.999 1, but also the MAE and RMSEP of the test samples also reduced to 2.314 3and 3.874 5, respectively, which were reduced by 25.9% and 21.33% compared with out original CNN. Performance testing of the prediction model, indicates that the detection limit is 0.28 mg·L-1and the measurement range is 2.8~500 mg·L-1. This paper describes an innovative combination of a CNN with spectral analysis and reports our pioneering ideas on the application of spectral analysis in the field of water quality detection.
|
Received: 2019-02-20
Accepted: 2020-01-01
|
|
Corresponding Authors:
LIU Xin
E-mail: liuxin_CN@qq.com
|
|
[1] Skuras D,Tyllianakis E. Water Research,2018, 143:198.
[2] Li J,Luo G B,He L J,et al. Critical Reviews in Analytical Chemistry,2017, 48:47.
[3] Liu F,Zheng P C,Huang B C,et al. IFIP Advances in Information and Communication Technology,2017, 478:619.
[4] Alves F C G B S,Coqueiro, A,Marco, P H,et al. Food Chemistry 2018, 273: 124.
[5] Yao N,Liu Z A,Chen Y,et al. Sensors,2015, 15:20501.
[6] Chen J,Liu S,Qi X,et al. Sensors & Actuators B Chemical, 2018, 254: 778.
[7] Guan L,Tong Y F,Li J W,et al. Optik, 2018, 164: 277.
[8] Mason J D,Cone M T,Fry E S. Applied Optics,2016, 55:7163.
[9] He L,Kaoru O,Dong M X. IEEE Network,2018, 32:96.
[10] Kalinin A A,Higgins G A. Pharmacogenomics,2018, 19:629.
[11] Gholizadeh M H,Melesse A M,Reddi L. Sensors,2016, 16:1298.
[12] Al-Saffar A A M,Tao H, Talab M A. International Conference on Radar,2018.
[13] Schettino B M,Duque C A,Silveira P M. IEEE Transactions on Power Delivery,2016, 31:1400.
[14] Saing V,Vorasayan P, Suwanwela N C. Iet Image Processing,2018, 12:105.
[15] Liakos K G,Busato P,Moshou D,et al. Sensors,2018, 18:2674.
[16] Zhang M F. Modern Physics Letters B,2017, 31.
[17] He F,Zhang L Y. Journal of Process Control,2018, 66:51.
[18] Castro W,Prieto J M,Guerra R,et al. Journal of Food Engineering,2018, 238:95.
[19] Fernandez-Espinosa A J. Talanta,2016, 148:216.
[20] Khan S,Ullah R,Khan A. Applied Spectroscopy,2017, 71:2111.
[21] Alessio S M. Signals & Communication Technology,2016. 1.
[22] Alberto S G,Dora B H,Francisco A. Journal of Supercomputing,2018, 3:1.
[23] Chen L,Hu X M,Xu T,et al. IEEE Transactions on Intelligent Transportation Systems,2017, 18:3303.
[24] Ghorbani M A,Zadeh H A,Isazadeh M,et al. Environmental Earth Sciences 2016, 75: 476.
[25] Feng W W,Li D,Cai Z Q,et al. International Symposium on Advanced Optical Manufacturing & Testing Technologies: Optical Test,2016, 9684.
[26] Li A,Li Y X,Li X H. Tensor Flow and Keras-based Convolutional Neural Network in CAT Image Recognition. 2017 2nd International Conference on Computational Modeling, Simulation and Applied Mathematics (CMSAM),2017. 529.
[27] Salehi N,Monsefi R,Yazdi H S. Knowledge-Based Systems,2018, 151:62.
[28] Zhao H Z,Liu F X,Li L Y,et al. Applied Intelligence,2017, 48:1707.
[29] Bako S,Vogels T,Mcwilliams B,et al. ACM Transactions on Graphics,2017, 36:1.
[30] Kingma D P,Ba J. Adam: A Method for Stochastic Optimization. Computer Science,2014.
[31] Chen B S,Wu H A,Li S F Y. Talanta,2014, 120:325.
[32] de Myttenaere A,Golden B,Le Grand B,et al. Neurocomputing,2016, 192:38.
[33] Khair U,Fahmi H,Al Hakim S,et al. Forecasting Error Calculation with Mean Absolute Deviation and Mean Absolute Percentage Error. International Conference on Information and Communication Technology (IconICT),2017. 930.
[34] Wang X Z,Wang R,Xu C. IEEE Transactions on Cybernetics,2017, 48:703.
[35] Zhao H, Liu F, Li L, et al. Applied Intelligence, 2018, 48(7): 1707.
[36] LIU Fei, DONG Da-ming, ZHAO Xian-de, et al. Spectroscopy and Spectral Analysis,2017, 37(9):2724.
[37] Jiang M Y,Liang Y C,Feng X Y, et al. Neural Computing & Applications, 2016, 29: 61. |
[1] |
LI Xin-ting, ZHANG Feng, FENG Jie*. Convolutional Neural Network Combined With Improved Spectral
Processing Method for Potato Disease Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 215-224. |
[2] |
LAN Yan1,WANG Wu1,XU Wen2,CHAI Qin-qin1*,LI Yu-rong1,ZHANG Xun2. Discrimination of Planting and Tissue-Cultured Anoectochilus Roxburghii Based on SMOTE and Inception-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 158-163. |
[3] |
HAO Zi-yuan1, YANG Wei1*, LI Hao1, YU Hao1, LI Min-zan1, 2. Study on Prediction Models for Leaf Area Index of Multiple Crops Based on Multi-Source Information and Deep Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3862-3870. |
[4] |
WANG Qi-biao1, HE Yu-kai1, LUO Yu-shi1, WANG Shu-jun1, XIE Bo2, DENG Chao2*, LIU Yong3, TUO Xian-guo3. Study on Analysis Method of Distiller's Grains Acidity Based on
Convolutional Neural Network and Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3726-3731. |
[5] |
HUANG Meng-qiang1, KUANG Wen-jian2, 3*, LIU Xiang1, HE Liang4. Quantitative Analysis of Cotton/Polyester/Wool Blended Fiber Content by Near-Infrared Spectroscopy Based on 1D-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3565-3570. |
[6] |
CAI Jian-rong1, 2, HUANG Chu-jun1, MA Li-xin1, ZHAI Li-xiang1, GUO Zhi-ming1, 3*. Hand-Held Visible/Near Infrared Nondestructive Detection System for Soluble Solid Content in Mandarin by 1D-CNN Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2792-2798. |
[7] |
LI Xin-xing1, 2, ZHANG Ying-gang1, MA Dian-kun1, TIAN Jian-jun3, ZHANG Bao-jun3, CHEN Jing4*. Review on the Application of Spectroscopy Technology in Food Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2333-2338. |
[8] |
WANG Yi-ru1, GAO Yang2, 3, WU Yong-gang4*, WANG Bo5*. Study of the Electronic Structure, Spectrum, and Excitation Properties of Sudan Red Ⅲ Molecule Based on the Density Functional Theory[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2426-2436. |
[9] |
PU Shan-shan, ZHENG En-rang*, CHEN Bei. Research on A Classification Algorithm of Near-Infrared Spectroscopy Based on 1D-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2446-2451. |
[10] |
TANG Ting, PAN Xin*, LUO Xiao-ling, GAO Xiao-jing. Fusion of ConvLSTM and Multi-Attention Mechanism Network for
Hyperspectral Image Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2608-2616. |
[11] |
LI Wen-xia1, DU Yu-jun2, WANG Yue1, LIU Zheng-dong3*, ZHENG Jia-hui1, DU Wen-qian1, WANG Hua-ping4. Research on On-Line Efficient Near-Infrared Spectral Recognition and Automatic Sorting Technology of Waste Textiles Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2139-2145. |
[12] |
LIANG Wan-jie1, FENG Hui2, JIANG Dong3, ZHANG Wen-yu1, 4, CAO Jing1, CAO Hong-xin1*. Early Recognition of Sclerotinia Stem Rot on Oilseed Rape by Hyperspectral Imaging Combined With Deep Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2220-2225. |
[13] |
JIANG Xia*, QIU Bo, WANG Lin-qian, GUO Xiao-yu. Automatic Classification Method of Star Spectra Based on
Semi-Supervised Mode[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1875-1880. |
[14] |
FENG Ying-chao1, HUANG Yi-ming2*, LIU Jin-ping1, JIA Chen-peng2, CHEN Peng1, WU Shao-jie2*, REN Xu-kai3, YU Huan-wei3. On-Line Monitoring of Laser Wire Filling Welding Process Based on Emission Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1927-1935. |
[15] |
ZHENG Zhi-jie1, LIN Zhen-heng1, 2*, XIE Hai-he2, NIE Yong-zhong3. The Method of Terahertz Spectral Classification and Identification for Engineering Plastics Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(05): 1387-1393. |
|
|
|
|