|
|
|
|
|
|
| Online Detecting Water Quality Anomaly from UV/Vis Spectra Using Baseline Correction and Principal Component Analysis Method |
| GUO Bing-bing, HOU Di-bo, JIN Yu, YIN Hang, HUANG Ping-jie*, ZHANG Guang-xin, ZHANG Hong-jian |
| State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China |
|
|
|
|
Abstract In recent years, water quality security issue has aroused widespread social concerns. Ultraviolet and visible absorption spectrum for real- time monitoring of water quality has the advantages of in- situ detection as well as no need for reagents and rapid analysis, which makes it suitable for online detection. However, the ultraviolet and visible spectra are of large size and easily interfered by instrument and the normal water quality fluctuation, which affect the water quality anomaly detection result. In this paper, the baseline correction and principal component analysis method for UV/Vis spectra is proposed to detect abnormal water quality. The asymmetric least squares algorithm is used to correct the baseline and the principal component analysis for UV/Vis spectral matrix is adopted to reduce dimensions and extract features. Afterwards the outliers in the test samples are evaluated according to the Q statistic in the residual subspace. Finally, anomalies warning is updated by calculating the cumulative probability. The performance of the proposed method is evaluated by using data from phenol injection experiments. Results show that the proposed method effectively improves the detection limit of pollutants and has a higher detection rate and lower false alarm rate compared with the result without baseline correction.
|
|
Received: 2016-05-11
Accepted: 2016-10-06
|
|
|
|
Corresponding Authors:
HUANG Ping-jie
E-mail: huangpingjie@zju.edu.cn
|
|
[1] Hasan J, States S, Deininger R. Journal of Contemporary Water Research & Education, 2004, 129(1): 27.
[2] Liu S, Che H, Smith K, et al. Environmental Science: Processes & Impacts, 2014, 16(8): 2028.
[3] Byer D, Carlson K H. Journal (American Water Works Association), 2005. 130.
[4] Perelman L, Arad J, Housh M, et al. Environmental Science & Technology, 2012, 46(15): 8212.
[5] Arad J, Perelman L, Ostfeld A. World Environmental and Water Resources Congress 2012@ sCrossing Boundaries. ASCE, 2012. 2903.
[6] Liu S, Smith K, Che H. Water Research, 2015, 80: 109.
[7] HE Hui-mei, HOU Di-bo, ZHAO Hai-feng(何慧梅，侯迪波，赵海峰). Journal of Zhejiang University(浙江大学学报·工学版), 2013, 4: 26.
[8] CHU Xiao-li(褚小立). Molecular Spectroscopy Analytical Technology Combined with Chemometrics and Its Applications(化学计量学方法与分子光谱分析技术). Beijing: Chemical Industry Press(北京：化学工业出版社)，2011. 54.
[9] Langergraber G, Weingartner A, Fleischmann N. Automation in Water Quality Monitoring Ⅱ, 2004, 50(11): 13.
[10] Langergraber G, Broeke J, Lettl W, et al. Spectroscopy Europe, 2006, 18(4): 19.
[11] Durrenmatt D, Gujer W. Water Science & Technology, 2011, 63(6): 1153.
[12] Hou D, Liu S, Zhang J, et al. Journal of Spectroscopy, 2014.
[13] Hou D, Zhang J, Yang Z, et al. Optics Express, 2015, 23(13): 17487.
[14] Eilers P H C, Boelens H F M. Leiden University Medical Centre Report, 2005.
[15] Lourenco N D, Paixo F, Pinheiro H M, et al. Applied Spectroscopy, 2010, 64(9): 1061.
[16] Chiang L H, Braatz R D, Russell E L. Springer Science & Business Media, 2001. |
| [1] |
CHEN Chao-yang1, 2, LIU Cui-hong1, 2, LI Zhi-bin3, Andy Hsitien Shen1, 2*. Alexandrite Effect Origin of Gem Grade Diaspore[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2557-2562. |
| [2] |
WANG Zi-min1, MAO Xiao-tian1, YIN Zuo-wei1*, CHEN Chang2, CHENG Tian-jia1. Study on the Spectral Characteristics and the Color-Change Effect of Spinel[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3541-3545. |
| [3] |
REN Qian-qian1*, YUAN Yi-chai2. Study on Spectroscopy of Sphene From Pakistan[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2263-2268. |
| [4] |
HUANG Ping-jie, LI Yu-han, YU Qiao-jun, WANG Ke, YIN Hang, HOU Di-bo*, ZHANG Guang-xin. Classification of Organic Contaminants in Water Distribution Systems Developed by SPA and Multi-Classification SVM Using UV-Vis Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(07): 2267-2272. |
| [5] |
CHEN Chao-yang1, HUANG Wei-zhi1, SHAO Tian1, SHEN Che1, LI Zhi-bin2, Andy Hsitien Shen1*. The Study on UV-Vis Spectrum of a Special Color-Changed Sapphire[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2470-2473. |
| [6] |
YIN Hang, YU Qiao-jun, HOU Di-bo*, HUANG Ping-jie, ZHANG Guang-xin, ZHANG Hong-jian. In-Situ Detection of Water Quality Anomaly with UV/Vis Spectrum Based on Supervised Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(02): 491-499. |
| [7] |
TANG Zhu-rui1, 2, XI Bei-dou1, 3, 4, HE Xiao-song1, 3, TAN Wen-bing1, 3, ZHANG Hui1, 3, LI Dan1, 3, HUANG Cai-hong1, 3*. Structural Characteristics of Dissolved Organic Compounds during Swine Manure Composting[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(05): 1526-1532. |
| [8] |
MA Xiao2, YUAN Hong-fu1*, SONG Chun-feng1, HU Ai-qin1, LI Xiao-yu1, ZHAO Zhong2, LI Xiu-qin3, GUO Zhen3, ZHU Zhi-qiang1. Research on Rapid Discrimination of Edible Oil by ATR Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(07): 1879-1884. |
| [9] |
CHEN Ke-hai1,WANG Yu-lian1,GUO Ming3,ZHENG Xue-fang1,2*,TANG Qian1,MA Jun-yan1,GAO Da-bin2 . Study on the Interaction between Vincristine and Bovine Serum Albumin[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2008, 28(06): 1375-1378. |
|
|
|
|
