A Denoising Algorithm for Ultraviolet-Visible Spectrum Based on
CEEMDAN and Dual-Tree Complex Wavelet Transform
WANG Ren-jie1, 2, FENG Peng1*, YANG Xing3, AN Le3, HUANG Pan1, LUO Yan1, HE Peng1, TANG Bin1, 2*
1. Key Laboratory of Optoelectronic Technology and Systems of Ministry of Education, Chongqing University, Chongqing 400044, China
2. Chongqing Key Laboratory of Optical Fiber Sensing and Photoelectric Detection, Chongqing University of Technology, Chongqing 400054, China
3. College of Computer and Cyber Security, Chengdu University of Technology, Chengdu 610059, China
Abstract：The essence of measuring water quality COD by UV-vis absorption spectrometry is to model a large number of spectral data, and then introduce the measured spectral data to predict the process. However, there are two characteristic absorption peaks in the measured COD standard solution of potassium hydrogen phthalate at 200～300 nm, and the peak and peak values of the standard solution are also different at different concentrations. This feature is used to select the characteristic wavelength of this band and use it to characterize the spectral information, which reduces the data redundancy and improves the prediction accuracy. Because the measured water quality spectral signal is easily disturbed by the internal and external interference, resulting in a large number of non-stationary noise in the spectral data, and the characteristic absorption peak and its adjacent signal frequency is high, conventional denoising algorithms directly abandon high-frequency signals and can not accurately judge the limits of signal-to-noise components, resulting in the lack of effective signals. A joint denoising algorithm based on fully adaptive noise set empirical mode decomposition CEEMDAN (Complete Ensemble Empirical Mode Decomposition with Adaptive Noise) and dual-tree complex wavelet transform DT-CWT (The Dual-Tree Complex Wavelet Transform) is proposed. The algorithm uses CEEMDAN to decompose the signal into intrinsic mode function IMF (Intrinsic Mode Function). It makes linear correlation analysis through normalized autocorrelation function and cross-correlation number to determine the boundary between high-frequency noise components and low-frequency signal components. Then the DT-CWT threshold denoising algorithm is used to process the noisy high-frequency IMF component, and the IMF high-frequency component after DT-CWT processing is reconstructed from the IMF low-frequency component demarcated by CEEMDAN, and the final denoised signal is obtained. The experimental results show that the denoising algorithm based on CEEMDAN combined with dual-tree complex wavelet transform is suitable for data processing of UV-Vis spectrum water quality detection. For potassium hydrogen phthalate solution whose chemical oxygen demand (COD) standard solution is 100 mg·L-1, the denoising effect of SNR=24.201 5 dB, RMSE=0.024 0, NCC=0.999 4 and PSNR=37.573 6 denoised by the combined algorithm is significantly better than that of CEEMDAN and double-tree complex wavelet threshold algorithm. Moreover, it effectively retains the characteristic absorption peak of the original COD standard solution, suppresses the translation sensitivity and improves the smoothness of the reconstructed signal. The quality of the reconstructed signal is improved. It provides a new data pre-processing method for detecting water quality COD by UV-Vis spectrum.
汪仁杰，冯 鹏，杨 兴，安 乐，黄 盼，罗 燕，何 鹏，汤 斌. 一种CEEMDAN联合双树复小波的水质紫外-可见光谱去噪算法研究[J]. 光谱学与光谱分析, 2023, 43(03): 976-983.
WANG Ren-jie, FENG Peng, YANG Xing, AN Le, HUANG Pan, LUO Yan, HE Peng, TANG Bin. A Denoising Algorithm for Ultraviolet-Visible Spectrum Based on
CEEMDAN and Dual-Tree Complex Wavelet Transform. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 976-983.
[1] QI Wei，FENG Peng，WEI Biao(漆 伟，冯 鹏，魏 彪) . Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2021, 41(1): 194.
[2] QI Meng-meng, HAN Yan-he, SUN Qi(齐蒙蒙，韩严和，孙 齐). Environmental Science(环境科学), 2019, 38(11): 17.
[3] Christian, Evelyn, Batista, et al. Water Environment Research, 2017, 89(2): 168.
[4] ZHAO You-quan, WANG Hui-min, LIU Zi-yu(赵友全，王慧敏，刘子毓). Chinese Journal of Scientific Instrument(仪器仪表学报)，2010，31(9)：1927.
[5] Li Fengxiao, Tang Bin, Zhao Mingfu, et al. Journal of Spectroscopy, 2021, 2021: 6650630.
[6] JIA Rong, LI Tao-tao, XIA Zhou(贾 嵘，李涛涛, 夏 洲) . Journal of Hydraulic Engineering(水利学报), 2017, 48(3): 334.
[7] Wang W C, Chau K W, Xu D M, et al. Water Resources Management, 2015, 29(8): 2655.
[8] Tang L, Dai W, Yu L, et al. International Journal of Information Technology & Decision Making，2015, 14(1): 141.
[9] Chen Xihui, Chen Gang, Li Hongyu, et al. Journal of Mechanical Science and Technology, 2017, 31(3): 1035.
[10] LI Xiang-bo，GONG Jun，HU Dan(李相伯，龚 俊，胡 丹). Acta Photonica Sinica(光子学报), 2021, 50(5): 204.
