Abstract：In recent years, water quality security issue has aroused widespread social concerns. Ultraviolet and visible absorption spectrum for real- time monitoring of water quality has the advantages of in- situ detection as well as no need for reagents and rapid analysis, which makes it suitable for online detection. However, the ultraviolet and visible spectra are of large size and easily interfered by instrument and the normal water quality fluctuation, which affect the water quality anomaly detection result. In this paper, the baseline correction and principal component analysis method for UV/Vis spectra is proposed to detect abnormal water quality. The asymmetric least squares algorithm is used to correct the baseline and the principal component analysis for UV/Vis spectral matrix is adopted to reduce dimensions and extract features. Afterwards the outliers in the test samples are evaluated according to the Q statistic in the residual subspace. Finally, anomalies warning is updated by calculating the cumulative probability. The performance of the proposed method is evaluated by using data from phenol injection experiments. Results show that the proposed method effectively improves the detection limit of pollutants and has a higher detection rate and lower false alarm rate compared with the result without baseline correction.
Key words：UV/Vis spectrum; Water quality anomaly detection; Asymmetric least squares; Principal component analysis; Q statistic
[1] Hasan J, States S, Deininger R. Journal of Contemporary Water Research & Education, 2004, 129(1): 27.
[2] Liu S, Che H, Smith K, et al. Environmental Science: Processes & Impacts, 2014, 16(8): 2028.
[3] Byer D, Carlson K H. Journal (American Water Works Association), 2005. 130.
[4] Perelman L, Arad J, Housh M, et al. Environmental Science & Technology, 2012, 46(15): 8212.
[5] Arad J, Perelman L, Ostfeld A. World Environmental and Water Resources Congress 2012@ sCrossing Boundaries. ASCE, 2012. 2903.
[6] Liu S, Smith K, Che H. Water Research, 2015, 80: 109.
[7] HE Hui-mei, HOU Di-bo, ZHAO Hai-feng(何慧梅，侯迪波，赵海峰). Journal of Zhejiang University(浙江大学学报·工学版), 2013, 4: 26.
[8] CHU Xiao-li(褚小立). Molecular Spectroscopy Analytical Technology Combined with Chemometrics and Its Applications(化学计量学方法与分子光谱分析技术). Beijing: Chemical Industry Press(北京：化学工业出版社)，2011. 54.
[9] Langergraber G, Weingartner A, Fleischmann N. Automation in Water Quality Monitoring Ⅱ, 2004, 50(11): 13.
[10] Langergraber G, Broeke J, Lettl W, et al. Spectroscopy Europe, 2006, 18(4): 19.
[11] Durrenmatt D, Gujer W. Water Science & Technology, 2011, 63(6): 1153.
[12] Hou D, Liu S, Zhang J, et al. Journal of Spectroscopy, 2014.
[13] Hou D, Zhang J, Yang Z, et al. Optics Express, 2015, 23(13): 17487.
[14] Eilers P H C, Boelens H F M. Leiden University Medical Centre Report, 2005.
[15] Lourenco N D, Paixo F, Pinheiro H M, et al. Applied Spectroscopy, 2010, 64(9): 1061.
[16] Chiang L H, Braatz R D, Russell E L. Springer Science & Business Media, 2001.
