|
|
|
|
|
|
In-Situ Detection of Water Quality Anomaly with UV/Vis Spectrum Based on Supervised Learning |
YIN Hang, YU Qiao-jun, HOU Di-bo*, HUANG Ping-jie, ZHANG Guang-xin, ZHANG Hong-jian |
State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China |
|
|
Abstract Water resources are related to national economy and people’s livelihood, detection of water quality anomaly has attracted more attention because of the water pollution events happened in recent years. In this paper, the detection method of water quality anomaly with UV-Vis Spectrum based on supervised learning was proposed to solve the problems of existing methods, which behaved as a high detection limit and poor adaptability method. The pretreatment of orthogonal projection was used to correct the gap between different batches of spectral data. Afterwards the Partial Least Squares Discriminatory Analysis was adopted to extract the features from the data set. Outliers were found by comparing the alarm signal with the best threshold from the training set. Finally, Sequential Bayesian Method was used to update the probability of Contaminate Intrusion Events and to get the alarm sequence. The results showed that the proposed method had the lower detection limit than unsupervised method and the pretreatment of orthogonal projection improved the adaptability of detection method based on supervised learning for baseline changing.
|
Received: 2017-11-21
Accepted: 2018-04-19
|
|
Corresponding Authors:
HOU Di-bo
E-mail: houdb@zju.edu.cn
|
|
[1] HE Hui-mei, HOU Di-bo, ZHAO Hai-feng(何慧梅, 侯迪波, 赵海峰). Journal of Zhejiang University(浙江大学学报·工学版), 2013, (4): 735.
[2] Liu S, Smith K, Che H. Water Research, 2015, 80: 109.
[3] Hou D, Liu S, Zhang J, et al. Journal of Spectroscopy, 2014,2014:150636.
[4] Hou D, Zhang J, Yang Z, et al. Optics Express, 2015, 23(13): 17487.
[5] GUO Bing-bing, HOU Di-bo(郭冰冰,侯迪波). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2017, 37(5): 1460.
[6] Jean-Claude Boulet, Jean-Michel Roger, Chemometrics and Intelligent Laboratory Systems,2012,117: 61.
[7] Tormod Nzs, Tomas Isaksson, Tom Fearn, et al. A Userfriendly Guide to Multivariate Calibration and Classification. NIR Publication, 2004, 27.
[8] WANG Hui-wen(王惠文). Partial Least Squares Regression Method and Application(偏最小二乘回归方法及其应用). Beijing: National Defense Industry Press(北京: 国防工业出版社), 1999. 140.
[9] Brereton R G, Lloyd G R. Journal of Chemometrics, 2014,28:213.
[10] Perelman L, Arad J, Housh M, et al. Environmental Science & Technology, 2012, 46(15): 8212.
[11] CHU Xiao-li(褚小立). Molecular Spectroscopy Analytical Technology Combined with Chemometrics and Its Applications(化学计量学方法与分子光谱分析技术). Beijing: Chemical Industry Press(北京: 化学工业出版社), 2011. 106.
[12] ZHOU Zhi-hua(周志华). Machine Learning(机器学习). Beijing: Tsinghua University Press(北京: 清华大学出版社), 2016. 28. |
[1] |
CHEN Chao-yang1, 2, LIU Cui-hong1, 2, LI Zhi-bin3, Andy Hsitien Shen1, 2*. Alexandrite Effect Origin of Gem Grade Diaspore[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2557-2562. |
[2] |
CHEN Wan-jun1, XU Yuan-jie2, LU Zhi-yun3, QI Jin-hua3, WANG Yi-zhi1*. Discriminating Leaf Litters of Six Dominant Tree Species in the Mts. Ailaoshan Based on Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2119-2123. |
[3] |
HAN Xiao-long1, LIN Jia-sheng2, LI Jian-feng2*. SERS Analysis of Urine for Rapid Estimation of Human Energy Intake[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 489-494. |
[4] |
WANG Zi-min1, MAO Xiao-tian1, YIN Zuo-wei1*, CHEN Chang2, CHENG Tian-jia1. Study on the Spectral Characteristics and the Color-Change Effect of Spinel[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3541-3545. |
[5] |
FANG Yuan, HE Zhang-ping, ZHU Shi-chao, LIANG Xian-rong, JIN Gang*. In-Line Identification of Different Grades of GPPS Based on Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(09): 2759-2763. |
[6] |
YUAN Rui-rui1, WANG Bing2, LIU Gui-shan1*, HE Jian-guo1, WAN Guo-ling1, FAN Nai-yun1, LI Yue1, SUN You-rui1. Study on the Detection and Discrimination of Damaged Jujube Based on Hyperspectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(09): 2879-2885. |
[7] |
REN Qian-qian1*, YUAN Yi-chai2. Study on Spectroscopy of Sphene From Pakistan[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2263-2268. |
[8] |
YUAN Rui-rui, LIU Gui-shan*, HE Jian-guo, KANG Ning-bo, BAN Jing-jing, MA Li-min. Quantitative Damage Identification of Lingwu Long Jujube Based on Visible Near-Infrared Hyperspectral Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(04): 1182-1187. |
[9] |
LIANG Hao-yue, CHENG Xue-lian, YANG Wan-zhu, WEN Wei, DONG Shu-xu, ZHAO Shi-xuan, RU Yong-xin*. Study on Identification of Four Acute Leukemia Cell Lines Based on Laser Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(12): 3670-3679. |
[10] |
LU Xian-yong1, HE Wen-xuan2, 3*, CHEN Hao-cong2, HUANG Rui2, ZHANG Yan-jie2. Identification Model of Camellia Oil Based on 3D Fluorescence Spectra of Vegetable Oils[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(12): 3854-3859. |
[11] |
HUANG Ping-jie, LI Yu-han, YU Qiao-jun, WANG Ke, YIN Hang, HOU Di-bo*, ZHANG Guang-xin. Classification of Organic Contaminants in Water Distribution Systems Developed by SPA and Multi-Classification SVM Using UV-Vis Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(07): 2267-2272. |
[12] |
LU Wan-hong, LI Peng*, WANG Chu-biao, LIN Yan, LUO Jian-zhong. Identifying Eucalypt Hybrids and Cross Parents by Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(03): 873-877. |
[13] |
CHEN Chao-yang1, HUANG Wei-zhi1, SHAO Tian1, SHEN Che1, LI Zhi-bin2, Andy Hsitien Shen1*. The Study on UV-Vis Spectrum of a Special Color-Changed Sapphire[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2470-2473. |
[14] |
LU Wan-hong, QI Jie*, LUO Jian-zhong. Application of NIRs for Discrimination of Eucalyptus Hybrids[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(05): 1451-1457. |
[15] |
HAO Yong1, SHANG Qing-yuan1, RAO Min2, HU Yuan2. Identification of Wood Species Based on Near Infrared Spectroscopy and Pattern Recognition Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(03): 705-710. |
|
|
|
|