| 光谱学与光谱分析 |
|
|
|
|
|
| Denoising Algorithm of UV-Vis Spectroscopy on Water Quality Detection Based on Two-Dimension Restructuring and Dynamic Pane |
| WU De-cao1, 2, WEI Biao1*, FENG Peng1, TANG Bin1, LIU Juan1 |
1. Key Lab of Optoelectronic Technology and Systems, Ministry of Education, Chongqing University, Chongqing 400044, China
2. Chongqing Industry Polytechnic College, Chongqing 401120, China |
|
|
|
|
Abstract Based on the successful development of multi-parameter water quality detection system of UV-visible spectroscopy and the actual needs of accuracy, sensitivity, stability and other aspects in the measurement, the research is carried out to create a denoising algorithm of UV-visible spectroscopy on water quality detection based on Two-Dimension(2-D) restructuring and dynamic pane. As spectrometry water quality detection systems typically use low-cost industrial grade spectrometer, the CCD photon efficiency and stability are lower than research grade spectrometer, which is built with back-illuminated CCD and internal cooling thermostats. The output spectrum contains significant non-stationary noise, especially in the UV section and IR section. With the traditional denoising method, it is difficult to filter out the noise and retain spectral details at the same time. What’s more, in the case of online or in-situ real-time water quality measurement, the multiple-sample averaging method that commonly used in traditional denoising method may incur additional measurement error due to rapidly changed water sample. The new denoising algorithm proposed by this paper uses the continuous sampling with isochronous gap to expand spectral data into a 2-D matrix composed of spectrum and time axes. After a 2-D wavelet transformation, a variable-width pane which is able to slide horizontally in the coefficient matrix is set. The width of the pane is determined by the change rate of noise variance: the more rapid the rate changes, the narrower the width is. A dynamic denoising threshold is calculated with the wavelet coefficients in the pane and a threshold vector is created with pane sliding. Finally, the spectrum can be denoised by the threshold vector with wavelet shrinkage method. The experimental results show that this denoising algorithm not only removes the spectral non-stationary noise effectively, but also retains the spectral details, which is helpful to improve the accuracy of the instrument. Meanwhile, since time-domain average is not used here, the impact to the denoising performance on fast-changing of water samples is small, which is suitable for the online or in-situ water quality detection environment.
|
|
Received: 2014-12-08
Accepted: 2015-03-27
|
|
|
|
Corresponding Authors:
WEI Biao
E-mail: weibiao@cqu.edu.cn
|
|
[1] LOU Hong-qiang(楼鸿强). Water Quality Monitoring System Based on Embedded Technology and Distributed Database(基于嵌入式技术和分布式数据库的水质监测系统). Zhejiang University(浙江大学), 2007.
[2] van den Broeke Joep. Spectroscopy Europe, 2006, 18(4): 1.
[3] ZENG Tian-ling, WEN Zhi-yu, WEN Zhong-quan, et al(曾甜玲，温志渝，温中泉，等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2013, 33(4): 1098.
[4] LIU Zhen(刘 震). Water Resources Protection(水资源保护), 2008, 24(1): 69.
[5] Kaushik Patra. Embedded Cloud System for Ann-Cod Analysis Using UV Spectroscopy. San Jose State University, 2013.
[6] Joep van den Broeke, Günter Langergraberb, Andreas Weingartner. Spectroscopy Europe, 2006, 18(4): 1.
[7] TANG Bin, WEI Biao, MAO Ben-jiang, et al(汤 斌，魏 彪，毛本将，等). Laser & Optoelectronics Progress(激光与光电子学进展), 2014, 51：043002.
[8] FANG Yong-hua, KONG Chao, LAN Tian-ge, et al(方勇华，孔 超，兰天鸽，等). Optics and Precision Engineering(光学 精密工程), 2006, 14(6): 1088.
[9] Olivier Thomas, Christopher Burgess. UV-Visible Spectrophotometry of Water and Wastewater, Volume 27. Elsevier Science, 2007.
[10] Abramovich F, Sapatinas T, Silverman Y B. Journal of the Royal Statistical Society, Ser, B, 1998, 60: 725.
[11] Donoho D L. IEEE Transactions Information Theory, 1995, 43: 613.
[12] Zhang Xiao-ping. IEEE Signal Processing, 1998, 5(10): 265.
[13] FEI Pe-yan, GUO Bao-long(费佩燕，郭宝龙). Journal of XIDIAN University(西安电子科技大学学报), 2003, 39(8): 9.
[14] LI Shu-xia, WANG Ru-lin, LI Chun-mei, et al(李淑霞，王汝霖，李春梅，等). Application Research of Computers(计算机应用研究), 2007，(1): 220. |
| [1] |
WANG Ren-jie1, 2, FENG Peng1*, YANG Xing3, AN Le3, HUANG Pan1, LUO Yan1, HE Peng1, TANG Bin1, 2*. A Denoising Algorithm for Ultraviolet-Visible Spectrum Based on
CEEMDAN and Dual-Tree Complex Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 976-983. |
| [2] |
WANG Zhong, WAN Dong-dong, SHAN Chuang, LI Yue-e, ZHOU Qing-guo*. A Denoising Method Based on Back Propagation Neural Network for
Raman Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1553-1560. |
| [3] |
ZHU Hong-qiu1, CHENG Fei1, HU Hao-nan1, ZHOU Can1, 2*, LI Yong-gang1. Denoising Algorithm of Spectral Signal Based on FFT SVD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 277-281. |
| [4] |
JIAO Qing-liang1, LIU Ming1*, YU Kun2, LIU Zi-long2, 3, KONG Ling-qin1, HUI Mei1, DONG Li-quan1, ZHAO Yue-jin1. Spectral Pre-Processing Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 292-297. |
| [5] |
ZHOU Kun-peng1, LIU Shuang-shuo1, CUI Jian1, ZHANG Hong-na1, BI Wei-hong2*, TANG Wei2. Detection of Chemical Oxygen Demand (COD) of Water Quality Based on Fluorescence Emission Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(04): 1143-1148. |
| [6] |
ZHOU Kun-peng1, BAI Xu-fang1, BI Wei-hong2*. Detection of Chemical Oxygen Demand (COD) of Water Quality Based on Fluorescence Multi-Spectral Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(03): 813-817. |
| [7] |
ZHAO Ming-fu1, 2, TANG Ping1, 2, TANG Bin1, 2, 3*, HE Peng3, XU Yang-fei1, 2, DENG Si-xing1, 2, SHI Sheng-hui1, 2. Research on Denoising of UV-Vis Spectral Data for Water Quality Detection with Compressed Sensing Theory Based on Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(03): 844-850. |
| [8] |
DAI Dang-dang1, WANG Xian-pei1*, ZHAO Yu1, TIAN Meng1, LONG Jia-chuan1, ZHU Guo-wei1, ZHANG Long-fei2 . Research on Denoising Ultraviolet Spectrum Signal with An Improved Effective Singular Value Selection Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(07): 2139-2143. |
| [9] |
Vo Quang Sang1,2, FENG Peng1*, MI De-ling1, TANG Bin1,3, WEI Biao1 . Research on Properties of Light Scattering for Non-Spherical Suspended Particles in Water Based on T Matrix Model [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(10): 2691-2696. |
| [10] |
WEI Kang-lin1, 2, CHEN Ming1*, WEN Zhi-yu2, XIE Yin-ke2. Research on Signal Processing for Water Quality Monitoring Based on Continuous Spectral Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(12): 3368-3373. |
| [11] |
WEI Kang-lin1, 2, 3, WEN Zhi-yu1, 2, 3*, GUO Jian1, 2, 3，CHEN Song-bo1, 2, 3 . The Design and Experiment of Multi-Parameter Water Quality Monitoring Microsystem Based on MOEMS Microspectrometer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(07): 2009-2014. |
| [12] |
XU Ying-ying1,2, JIN Wei-qi2, MA Wen-wen2, LU Li-gen3, MU Sheng-bo2, NI Jun-xiong2 . Measurement of Night Sky Spectral Radiation and Analysis of Spectral Denoising [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(06): 1456-1459. |
| [13] |
ZHAO You-quan1, LI Yu-chun1, GUO Yi1, GU Bai-jun2, YANG Zhen2 . A Novel Technology for Water Quality Testing Based on UV Spectral Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(05): 1301-1305. |
| [14] |
ZHOU Lan1, 2, MO Zhi-hong1, 2*, WEN Zhi-yu1, WEI Wen-jing1, 2 . Simultaneous Detection of Phenol and Anionic Surfactant in Water Based on Continuous Spectrum [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(05): 1316-1319. |
|
|
|
|
