|
|
|
|
|
|
Application Research of Normalization Algorithm Based on EWMA-PCA in Standardization of Water Quality Spectral Data |
ZHOU Si-han1,2, HU Xin-yu1,2, TANG Bin1,2,3*, ZHAO Ming-fu1,2, LI Feng-xiao1,2, WANG Ren-jie1,2, XIAO Qi-sen1,2, XIAO Yu1,2 |
1. Key Laboratory of Modern Optoelectronic Detection Technology and Instrument, Chongqing University of Technology, Chongqing 400054, China
2. Chongqing Key Laboratory of Optical Fiber Sensing and Photoelectric Detection, Chongqing University of Technology, Chongqing 400054, China
3. Key Laboratory of Optoelectronic Technology and Systems of Ministry of Education, Chongqing University, Chongqing 400044, China |
|
|
Abstract Model transfer is important for solving the inconsistency of measurement signals due to differences in sample and instrument response functions, and an effective method for solving model transfer is the instrument or data standardization. For the existing spectral standardization methods, there are few applied research on UV-visible absorption spectrum, and the UV-visible spectroscopy water quality multi-parameter detection spectrum detection unit has inconsistent resolution, accuracy, and response range, which is difficult to perform between different instruments. The problem of the comparison of test data and the fitting of multi-parameter data, this paper proposes to use the EWMA-PCA normalization algorithm to achieve the model transfer of UV-visible water quality spectra on different instruments’ (Exponentially Weighted Moving-Average) is an exponentially weighted average moving algorithm for finding phylogenetic trees with a high probability of generating UV-Visible water spectral data and recovering theoretical UV-visible water quality spectral data with maximum probability. The UV-Vis spectral characteristics are not lost or offset, reducing the impact of data processing on the UV-visible water spectral data. In this experiment, different concentrations of potassium hydrogen phthalate solution were used to compare and test the Japanese Hamamatsu C10082CAH spectrometer, the US Ocean Optics Maya2000Pro spectrometer and the Xiamen Optosky ATP2000 spectrometer. In the comparison group 1, the source machine Hamamatsu C10082CAH spectrometer and the target machine ocean Maya2000Pro spectrometer were selected, the comparison group 2 selected the source machine Hamamatsu C10082CAH spectrometer and the target machine Optosky ATP2000 spectrometer, and the comparison group 3 selected the source machine marine Maya2000Pro spectrometer and the target machine Optosky ATP2000 spectrometer. The experimental results of three sets of experiments show that the algorithm can be applied to different ratiometric spectrometers. After the EWMA-PCA normalization algorithm is used to standardize the water absorption spectrum data, the correlation coefficient reaches 99.576 5%, and the variance reaches 0.082 3%, and the peak offset can be reduced to 0.000 5%. Based on the EWMA-PCA normalized spectral normalization algorithm, it has wide adaptability, less need to transfer samples, and high transmission precision. The research results are widely used in spectroscopy water quality testing instruments. It has important theoretical guiding significance and reference value for engineering application.
|
Received: 2019-10-16
Accepted: 2020-02-05
|
|
Corresponding Authors:
TANG Bin
E-mail: tangbin@cqut.edu.cn
|
|
[1] Zhao H, Hou D, Huang P, et al. Water, Air & Soil Pollution, 2014, 225(11): 2183.
[2] TANG Bin, ZHAO Jing-xiao, WEI Biao, et al(汤 斌,赵敬晓,魏 彪,等). China Environmental Science(中国环境科学), 2015, 35(2): 478.
[3] SHI Yun-ying, LI Jing-yan, CHU Xiao-li(史云颖,李敬岩,褚小立). Chinese Journal of Analytical Chemistry(分析化学), 2019, 47(4): 479.
[4] Dong X, Dong J, Li Y, et al. Computers and Electronics in Agriculture, 2019, 156: 669.
[5] CHEN Yi-yun, QI Tian-ci, HUANG Ying-jing, et al(陈奕云,齐天赐,黄颖菁,等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2017, 33(6): 107.
[6] Haiyong W, Jingwen L, Haiyan C, et al. Sensors and Actuators B: Chemical, 2018, 275: 50.
[7] Pasquini, Celio. Analytica Chimica Acta, 2018, 1026: 8.
[8] XU Hui-rong, LI Qing-jing(徐惠荣,李青菁). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2017,(9): 312.
[9] Qin Y, Gong H. Infrared Physics & Technology, 2016, 77: 239.
[10] NI Li-jun, HAN Ming-yue, ZHANG Li-guo, et al(倪力军,韩明月,张立国,等). Chinese Journal of Analytical Chemistry(分析化学), 2018, 46(10): 163.
[11] JIA Yi-fei, ZHANG Ying-ying, XU Bing, et al(贾一飞,张盈盈,徐 冰,等). China Journal of Chinese Materia Medica(中国中药杂志), 2017, 42(12): 2298. |
[1] |
CAI Jian-rong1, 2, HUANG Chu-jun1, MA Li-xin1, ZHAI Li-xiang1, GUO Zhi-ming1, 3*. Hand-Held Visible/Near Infrared Nondestructive Detection System for Soluble Solid Content in Mandarin by 1D-CNN Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2792-2798. |
[2] |
FAN Ya-wen, LIU Yan-ping*, QIU Bo, JIANG Xia, WANG Lin-qian, WANG Kun. Research on Spectral Classification of Stellar Subtypes Based on
SSTransformer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2523-2528. |
[3] |
OUYANG Ke-chen1, 2, XING Li2, WANG Zheng2, 3, FENG Xiao-juan2*, ZHANG Jin-tao2, REN Cheng1, YANG Xing-tuan1. Analysis and Suppression of Laser-Induced Error in Temperature
Measurement Based on Nitrogen-Vacancy Centers in Diamond[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1242-1247. |
[4] |
FU Peng-you1, 2, WEN Yue2, ZHANG Yu-ke3, LI Ling-qiao1*, YANG Hui-hua1, 2*. Deep Learning Modelling and Model Transfer for Near-Infrared Spectroscopy Quantitative Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 310-319. |
[5] |
HU Guo-tian1, 2, 3, SHANG Hui-wei1, 2, 3, TAN Rui-hong1, XU Xiang-hu1, PAN Wei-dong1. Research on Model Transfer Method of Organic Matter Content
Estimation of Different Soils Using VNIR Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3148-3154. |
[6] |
LU Ya-kun1, QIU Bo1*, LUO A-li2, GUO Xiao-yu1, WANG Lin-qian1, CAO Guan-long1, BAI Zhong-rui2, CHEN Jian-jun2. Classification of 2D Stellar Spectra Based on FFCNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1881-1885. |
[7] |
LI Ming-liang1, DAI Yu-jia1, QIN Shuang1, SONG Chao2*, GAO Xun1*, LIN Jing-quan1. Influence of LIBS Analysis Model on Quantitative Analysis Precision of Aluminum Alloy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 587-591. |
[8] |
FAN Shu-xiang1, WANG Qing-yan1, YANG Yu-sen2, LI Jiang-bo1, ZHANG Chi1, TIAN Xi1, HUANG Wen-qian1*. Development and Experiment of a Handheld Visible/Near Infrared Device for Nondestructive Determination of Fruit Sugar Content[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(10): 3058-3063. |
[9] |
LI Shuo1, LI Chun-lian1, CHEN Song-chao3, 4, XU Dong-yun2, SHI Zhou2*. Removing the Effects of Water From Visible-Near Infrared Spectra in Soil Profiles for the Estimation of Organic Carbon[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(04): 1234-1239. |
[10] |
JIN Zhi1, MA Jian-feng2, FU Yue-jin1*. Research on the Distribution of Cell Wall Components and Porosity in Populous Nigra Tension Wood Fiber Based on Raman Imaging Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(03): 801-806. |
[11] |
ZHOU Zi-kun1, 2, LI Chen-xi2 *, WANG Zhe1, 2, LIU Rong1, 2, CHEN Wen-liang1, 2, XU Ke-xin1, 2. Study on Cefradine Granules Component Analysis and Calibration Transfer Method Based on Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(11): 3562-3566. |
[12] |
ZHOU Mo1, 2, ZOU Bin1, 2*, TU Yu-long1, 2, XIA Ji-pin1, 2. Hyperspectral Modeling of Pb Content in Mining Area Based on Spectral Feature Band Extracted from Near Standard Soil Samples[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(07): 2182-2187. |
[13] |
ZHONG Qi-xiu1, 2, 3, ZHAO Tian-zhuo1, 2, 3*, LI Xin1, 2, 3, LIAN Fu-qiang1, 3, XIAO Hong1, 3, NIE Shu-zhen1, 3, SUN Si-ning3, 4, FAN Zhong-wei1, 2, 3. Standardized Cross-Validation and Its Optimization for Multi-Element LIBS Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 622-627. |
[14] |
ZHANG Tian-tian1, LI Bing2*, CAI Gui-min2, LI Jun-hui1*, MA Yan-jun3, MA Li3, ZHAO Long-lian1, WU Shu-en2. Study on Spectral Data Processing Methods of New Type High-Density Grating Spectrometer Made in China[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2651-2656. |
[15] |
SUN Hai-xia, ZHANG Shu-juan*, XUE Jian-xin, ZHAO Xu-ting, XING Shu-hai, CHEN Cai-hong, LI Cheng-ji. Model Transfer Method of Fresh Jujube Soluble Solids Detection Using Variables Optimization and Correction Algorithms[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(04): 1041-1046. |
|
|
|
|