Abstract:Water resources are related to national economy and people’s livelihood, detection of water quality anomaly has attracted more attention because of the water pollution events happened in recent years. In this paper, the detection method of water quality anomaly with UV-Vis Spectrum based on supervised learning was proposed to solve the problems of existing methods, which behaved as a high detection limit and poor adaptability method. The pretreatment of orthogonal projection was used to correct the gap between different batches of spectral data. Afterwards the Partial Least Squares Discriminatory Analysis was adopted to extract the features from the data set. Outliers were found by comparing the alarm signal with the best threshold from the training set. Finally, Sequential Bayesian Method was used to update the probability of Contaminate Intrusion Events and to get the alarm sequence. The results showed that the proposed method had the lower detection limit than unsupervised method and the pretreatment of orthogonal projection improved the adaptability of detection method based on supervised learning for baseline changing.
Key words:UV-Vis spectrum; Water quality anomaly detection; Orthogonal projection; Supervised learning; Partial least squares discriminatory analysis
[1] HE Hui-mei, HOU Di-bo, ZHAO Hai-feng(何慧梅, 侯迪波, 赵海峰). Journal of Zhejiang University(浙江大学学报·工学版), 2013, (4): 735.
[2] Liu S, Smith K, Che H. Water Research, 2015, 80: 109.
[3] Hou D, Liu S, Zhang J, et al. Journal of Spectroscopy, 2014,2014:150636.
[4] Hou D, Zhang J, Yang Z, et al. Optics Express, 2015, 23(13): 17487.
[5] GUO Bing-bing, HOU Di-bo(郭冰冰,侯迪波). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2017, 37(5): 1460.
[6] Jean-Claude Boulet, Jean-Michel Roger, Chemometrics and Intelligent Laboratory Systems,2012,117: 61.
[7] Tormod Nzs, Tomas Isaksson, Tom Fearn, et al. A Userfriendly Guide to Multivariate Calibration and Classification. NIR Publication, 2004, 27.
[8] WANG Hui-wen(王惠文). Partial Least Squares Regression Method and Application(偏最小二乘回归方法及其应用). Beijing: National Defense Industry Press(北京: 国防工业出版社), 1999. 140.
[9] Brereton R G, Lloyd G R. Journal of Chemometrics, 2014,28:213.
[10] Perelman L, Arad J, Housh M, et al. Environmental Science & Technology, 2012, 46(15): 8212.
[11] CHU Xiao-li(褚小立). Molecular Spectroscopy Analytical Technology Combined with Chemometrics and Its Applications(化学计量学方法与分子光谱分析技术). Beijing: Chemical Industry Press(北京: 化学工业出版社), 2011. 106.
[12] ZHOU Zhi-hua(周志华). Machine Learning(机器学习). Beijing: Tsinghua University Press(北京: 清华大学出版社), 2016. 28.