|
|
|
|
|
|
Research on Denoising of UV-Vis Spectral Data for Water Quality Detection with Compressed Sensing Theory Based on Wavelet Transform |
ZHAO Ming-fu1, 2, TANG Ping1, 2, TANG Bin1, 2, 3*, HE Peng3, XU Yang-fei1, 2, DENG Si-xing1, 2, SHI Sheng-hui1, 2 |
1. Key Laboratory of Modern Optoelectronic Detection Technology and Instrument, Chongqing University of Technology, Chongqing 400054, China
2. Chongqing Key Laboratory of Optical Fiber Sensing and Photoelectric Detection, Chongqing University of Technology, Chongqing 400054, China
3. Key Laboratory of Optoelectronic Technology and Systems of Ministry of Education, Chongqing University, Chongqing 400044, China |
|
|
Abstract It is of great significance to improve the measurement stability and accuracy of water quality detection system with direct spectrum method. Direct spectroscopy on-line water quality detection systems typically use long-lived, preheated pulsed xenon lamps and industrial-grade spectral detection devices for complex inspection environments. Since the whole spectral detection system is affected by the light source, the optical path and the photoelectric conversion device, the measured spectral data contains a large amount of noise, a wavelet denoising algorithm based on compressed sensing is proposed, which is compared with the traditional wavelet threshold denoising method. In this paper, the denoising was performed on the UV-Vis spectra of the standard solution of potassium hydrogen phthalate with chemical oxygen demand of 200 mg·L-1. The compressed sensing algorithm is used to decompose the signal in the wavelet domain, and the high frequency coefficients are obtained. Using the random Gaussian matrix as the observation matrix of the compression sensing algorithm, the compression ratio is set to 2, and the high frequency coefficients are observed. The orthogonal matching algorithm is used to recover the sparsity of the high frequency wavelet coefficients to achieve the denoising. At the same time, for the traditional wavelet threshold denoising, the soft-threshold filtering method is used to denoise the spectral data, and the wavelet base is daubechies 4. In order to verify the feasibility of the noise reduction algorithm, the spectral signals of a stream and domestic sewage were collected, and the above two methods were used to denoise the spectral signal. The experimental results show that the compressed sensing algorithm based on wavelet transform is suitable for the on-line water quality detection system based on UV-Vis spectroscopy. The method can effectively denoise under the premise of preserving the absorption characteristics of the original spectral signal of the water sample, and the denoising effect is better than the wavelet threshold denoising algorithm. Compared with the wavelet threshold denoising algorithm, the SNR is increased by 12.201 5 dB, the RMSE is neduced by 0.009 3, and the PSNR is increased by 5.299 dB. The proposed method not only avoids the problem of threshold selection in wavelet threshold denoising, but also effectively suppresses the noise in the reconstruction process. This method provides a new solution for direct spectroscopy to detect water quality parameters.
|
Received: 2017-03-28
Accepted: 2017-07-19
|
|
Corresponding Authors:
TANG Bin
E-mail: tangbin@cqut.edu.cn
|
|
[1] TANG Bin, WEI Biao, WU De-cao(汤 斌, 魏 彪, 吴德操). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2014,34(11): 3020.
[2] ZHOU Shi-long, GONG De-ren, DUAN Deng-ping(周世龙, 龚德仁, 段登平). Sensor and Micro Systems(传感器与微系统), 2015, 34(3): 154.
[3] TANG Bin, WEI Biao, MAO Ben-jiang(汤 斌, 魏 彪, 毛本将). Progress in Lasers and Optoelectronics(激光与光电子学进展), 2014(4): 197.
[4] Feng Z, Liang M, Chu F. Mechanical Systems and Signal Processing, 2013, 38(1): 165.
[5] Al-Qazzaz N K, Ali S, Ahmad S A, et al. Biomedical Engineering and Sciences (IECBES), 2014 IEEE Conference on. IEEE, 2014. 214.
[6] Zhu W, Chen B X. Multidimensional Systems and Signal Processing, 2015, 26(1): 113.
[7] CHEN Yu-shan, ZHANG Xiong-wei, YANG Ji-bin(陈栩杉, 张雄伟, 杨吉斌). Acta Automatica Sinica(自动化学报), 2015, 42(3): 335.
[8] Feng W, Fengwei C, Jia W. Open Electrical & Electronic Engineering Journal, 2015, 9: 74.
[9] ZHANG Jia-yan, HE Wei-ji, CHEN Qian(庄佳衍, 何伟基, 陈 钱). Chinese Journal of Optics(光子学报), 2015, 44(12): 70.
[10] TIAN Wen-biao, KANG Jian, ZHANG Yang(田文飚, 康 健, 张 洋). Electronic Journal(电子学报), 2014, 42(6): 1061.
[11] LI Hui-juan, GONG Xian-yong, LI Ying-cheng(李会娟, 巩现勇, 李英成). Science of Surveying and Mapping(测绘科学), 2014, 39(4): 131.
[12] Metzler C A, Maleki A, Baraniuk R G. IEEE Transactions on Information Theory, 2016, 62(9): 5117.
[13] Wang R, Yang Z, Liu L, et al. ACM Transactions on Graphics (TOG), 2014, 33(2): 18.
[14] Lopes M E. IEEE Transactions on Information Theory, 2016, 62(9): 5145.
[15] Majumdar A, Ansari N, Aggarwal H, et al. Signal Processing, 2016, 119: 136.
[16] WANG Qiang, LI Jia, SHEN Yi(王 强, 李 佳, 沈 毅). Chinese Journal of Electronics(电子学报), 2013, 41(10): 2041.
[17] Ma Q, Quan X, Zhong Y, et al. Cogent Engineering, 2016, 3(1): 1247611.
[18] YUAN Qin, WU Xuan-gou, XIONG Yan(袁 琴, 吴宣够, 熊 焰). Computer Science(计算机科学), 2014, 41(3): 314. |
[1] |
ZHU Yu-chen1, 2, WANG Yan-cang3, 4, 5, LI Xiao-fang6, LIU Xing-yu3, GU Xiao-he4*, ZHAO Qi-chao3, 4, 5. Study on Quantitative Inversion of Leaf Water Content of Winter Wheat Based on Discrete Wavelet Technique[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2902-2909. |
[2] |
ZHU Yan-ping1, CUI Chuan-jin1*, CHENG Peng-fei1, 2, PAN Jin-yan1, SU Hao1, 2, ZHANG Yi1. Measurement of Oil Pollutants by Three-Dimensional Fluorescence
Spectroscopy Combined With BP Neural Network and SWATLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2467-2475. |
[3] |
WANG Ren-jie1, 2, FENG Peng1*, YANG Xing3, AN Le3, HUANG Pan1, LUO Yan1, HE Peng1, TANG Bin1, 2*. A Denoising Algorithm for Ultraviolet-Visible Spectrum Based on
CEEMDAN and Dual-Tree Complex Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 976-983. |
[4] |
LI Hu1, 2, 3, LIU Xue-feng1, 3*, YAO Xu-ri4, 5*, ZHAI Guang-jie1, 3. Block Compressed Sensing Computed-Tomography Imaging Spectrometry[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 348-355. |
[5] |
DENG Xian-ming1, ZHANG Tian-cai1, 3, LIU Zeng-can1 , LI Zhong-sheng1, XIONG Jie1, ZHANG Yi-xiang1, LIU Peng-hao1, CEN Yi2*, WU Fa-lin1. Adaptability Analysis of Multiple Features Detection Algorithms Based on Fusion Degree Model Between Target and Environment[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1285-1292. |
[6] |
REN Yong-tian, HU Yi, CHEN Jun, CHEN Jun*. Study on Compressed Sensing Method for Raman Spectroscopic Analysis of Isotope Hydrogen Gas[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(03): 776-782. |
[7] |
YAN Jing-tao1, MIAO Li-jun1*, MAO Jian-feng2, SHI Jin1, HUANG Teng-chao1, CHE Shuang-liang1, SHU Xiao-wu1. Laser Spectrum Broadening Method Based on Phase Modulation of Gaussian White Noise[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(03): 665-671. |
[8] |
XI Liang1,2, SI Fu-qi1*, JIANG Yu1, ZHOU Hai-jin1, QIU Xiao-han1, CHANG Zhen1. Ground-Based IDOAS De-Striping by Weighted Unidirectional Variation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 627-633. |
[9] |
ZHONG Ming-yu1, 2, 3, ZHOU Hai-jin2, SI Fu-qi2*, WANG Yu2, DOU Ke2, SU Jing-ming1, 2, 3. Reconstruction of Stack Plume Based on Imaging Differential Absorption Spectroscopy and Compressed Sensing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1708-1712. |
[10] |
ZHAO Shou-bo1,2, LI Xiu-hong1,2. Research on Reflection Spectrum Reconstruction Algorithm Based on Compressed Sensing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(04): 1092-1096. |
[11] |
LI Si-hai1, LIU Dong-ling2. Quantitative Analysis of Near Infrared Spectroscopy Based on Orthogonal Matching Pursuit Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(04): 1097-1101. |
[12] |
LIU Shi-jie1, 2, LI Chun-lai1,3*, XU Rui1, TANG Guo-liang1, 2, XU Yan1, 2, 4, WU Bing1, 2, WANG Jian-yu1, 2, 3*. Method for Evaluating Spectral Similarity Based on First-Order Gradient Information[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(03): 776-781. |
[13] |
QI Wei, FENG Peng*, WEI Biao, ZHENG Dong, YU Ting-ting, LIU Peng-yong. Feature Wavelength Optimization Algorithm for Water Quality COD Detection Based on Embedded Particle Swarm Optimization-Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 194-200. |
[14] |
WAN Liu-jie1, 2, ZHEN Chao3, QIU Zong-jia1, LI Kang1, MA Feng-xiang3, HAN Dong1, 2, ZHANG Guo-qiang1, 2*. Research of High Precision Photoacoustic Second Harmonic Detection Technology Based on FFT Filter[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(10): 2996-3001. |
[15] |
CAO Bing-hua1,LI Su-zhen1*,CAI En-ze1,FAN Meng-bao2,GAN Fang-xin1. Progress in Terahertz Imaging Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(09): 2686-2695. |
|
|
|
|