|
|
|
|
|
|
A Denoising Algorithm for Ultraviolet-Visible Spectrum Based on
CEEMDAN and Dual-Tree Complex Wavelet Transform |
WANG Ren-jie1, 2, FENG Peng1*, YANG Xing3, AN Le3, HUANG Pan1, LUO Yan1, HE Peng1, TANG Bin1, 2* |
1. Key Laboratory of Optoelectronic Technology and Systems of Ministry of Education, Chongqing University, Chongqing 400044, China
2. Chongqing Key Laboratory of Optical Fiber Sensing and Photoelectric Detection, Chongqing University of Technology, Chongqing 400054, China
3. College of Computer and Cyber Security, Chengdu University of Technology, Chengdu 610059, China
|
|
|
Abstract The essence of measuring water quality COD by UV-vis absorption spectrometry is to model a large number of spectral data, and then introduce the measured spectral data to predict the process. However, there are two characteristic absorption peaks in the measured COD standard solution of potassium hydrogen phthalate at 200~300 nm, and the peak and peak values of the standard solution are also different at different concentrations. This feature is used to select the characteristic wavelength of this band and use it to characterize the spectral information, which reduces the data redundancy and improves the prediction accuracy. Because the measured water quality spectral signal is easily disturbed by the internal and external interference, resulting in a large number of non-stationary noise in the spectral data, and the characteristic absorption peak and its adjacent signal frequency is high, conventional denoising algorithms directly abandon high-frequency signals and can not accurately judge the limits of signal-to-noise components, resulting in the lack of effective signals. A joint denoising algorithm based on fully adaptive noise set empirical mode decomposition CEEMDAN (Complete Ensemble Empirical Mode Decomposition with Adaptive Noise) and dual-tree complex wavelet transform DT-CWT (The Dual-Tree Complex Wavelet Transform) is proposed. The algorithm uses CEEMDAN to decompose the signal into intrinsic mode function IMF (Intrinsic Mode Function). It makes linear correlation analysis through normalized autocorrelation function and cross-correlation number to determine the boundary between high-frequency noise components and low-frequency signal components. Then the DT-CWT threshold denoising algorithm is used to process the noisy high-frequency IMF component, and the IMF high-frequency component after DT-CWT processing is reconstructed from the IMF low-frequency component demarcated by CEEMDAN, and the final denoised signal is obtained. The experimental results show that the denoising algorithm based on CEEMDAN combined with dual-tree complex wavelet transform is suitable for data processing of UV-Vis spectrum water quality detection. For potassium hydrogen phthalate solution whose chemical oxygen demand (COD) standard solution is 100 mg·L-1, the denoising effect of SNR=24.201 5 dB, RMSE=0.024 0, NCC=0.999 4 and PSNR=37.573 6 denoised by the combined algorithm is significantly better than that of CEEMDAN and double-tree complex wavelet threshold algorithm. Moreover, it effectively retains the characteristic absorption peak of the original COD standard solution, suppresses the translation sensitivity and improves the smoothness of the reconstructed signal. The quality of the reconstructed signal is improved. It provides a new data pre-processing method for detecting water quality COD by UV-Vis spectrum.
|
Received: 2021-11-19
Accepted: 2022-05-25
|
|
Corresponding Authors:
FENG Peng, TANG Bin
E-mail: coe-fp@cqu.edu.cn;tangbin@cqut.edu.cn
|
|
[1] QI Wei,FENG Peng,WEI Biao(漆 伟,冯 鹏,魏 彪) . Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2021, 41(1): 194.
[2] QI Meng-meng, HAN Yan-he, SUN Qi(齐蒙蒙,韩严和,孙 齐). Environmental Science(环境科学), 2019, 38(11): 17.
[3] Christian, Evelyn, Batista, et al. Water Environment Research, 2017, 89(2): 168.
[4] ZHAO You-quan, WANG Hui-min, LIU Zi-yu(赵友全,王慧敏,刘子毓). Chinese Journal of Scientific Instrument(仪器仪表学报),2010,31(9):1927.
[5] Li Fengxiao, Tang Bin, Zhao Mingfu, et al. Journal of Spectroscopy, 2021, 2021: 6650630.
[6] JIA Rong, LI Tao-tao, XIA Zhou(贾 嵘,李涛涛, 夏 洲) . Journal of Hydraulic Engineering(水利学报), 2017, 48(3): 334.
[7] Wang W C, Chau K W, Xu D M, et al. Water Resources Management, 2015, 29(8): 2655.
[8] Tang L, Dai W, Yu L, et al. International Journal of Information Technology & Decision Making,2015, 14(1): 141.
[9] Chen Xihui, Chen Gang, Li Hongyu, et al. Journal of Mechanical Science and Technology, 2017, 31(3): 1035.
[10] LI Xiang-bo,GONG Jun,HU Dan(李相伯,龚 俊,胡 丹). Acta Photonica Sinica(光子学报), 2021, 50(5): 204.
|
[1] |
WANG Yi-ru1, GAO Yang2, 3, WU Yong-gang4*, WANG Bo5*. Study of the Electronic Structure, Spectrum, and Excitation Properties of Sudan Red Ⅲ Molecule Based on the Density Functional Theory[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2426-2436. |
[2] |
LIU Mei-jun, TIAN Ning*, YU Ji*. Spectral Study on Mouse Oocyte Quality[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(05): 1376-1380. |
[3] |
CI Cheng-gang*, ZANG Jie-chao, LI Ming-fei*. DFT Study on Spectra of Mn-Carbonyl Molecular Complexes[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(05): 1434-1441. |
[4] |
CHEN Qing1, TANG Bin1, 2*, LONG Zou-rong1, 2, MIAO Jun-feng1, HUANG Zi-heng1, DAI Ruo-chen1, SHI Sheng-hui1, ZHAO Ming-fu1, ZHONG Nian-bing1. Water Quality Classification Using Convolution Neural Network Based on UV-Vis Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 731-736. |
[5] |
XU Meng-lei1, 2, GAO Yu3, ZHU Lin1, HAN Xiao-xia1, ZHAO Bing1*. Improved Sensitivity of Localized Surface Plasmon Resonance Using Silver Nanoparticles for Indirect Glyphosate Detection Based on Ninhydrin Reaction[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 320-323. |
[6] |
LI Qing-bo1, BI Zhi-qi1, CUI Hou-xin2, LANG Jia-ye2, SHEN Zhong-kai2. Detection of Total Organic Carbon in Surface Water Based on UV-Vis Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3423-3427. |
[7] |
YE Da-wei1, 2, DING Fang1*, LI Ke-dong1, 2, CHEN Xia-hua1, 2, LUO Yu1, 2, ZHANG Qing1, 2, MENG Ling-yi1, 2, LUO Guang-nan1, 2. Study on Time Delay of Impurity Line Emissions Between in the Edge and Core Plasmas in EAST Tokamak[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3507-3511. |
[8] |
HU Xin-yu1, 2, XU Zhang-hua1, 2, 3, 5, 6*, HUANG Xu-ying1, 2, 8, ZHANG Yi-wei1, 2, CHEN Qiu-xia7, WANG Lin1, 2, LIU Hui4, LIU Zhi-cai1, 2. Relationship Between Chlorophyll and Leaf Spectral Characteristics and Their Changes Under the Stress of Phyllostachys Praecox[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(09): 2726-2739. |
[9] |
LUO Heng, Andy Hsitien Shen*. Based on Color Calculation and In-Situ Element Analyze to Study the Color Origin of Purple Chalcedony[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1891-1898. |
[10] |
LI Qing-bo1, WEI Yuan1, CUI Hou-xin2, FENG Hao2, LANG Jia-ye2. Quantitative Analysis of TOC in Water Quality Based on UV-Vis Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 376-380. |
[11] |
YUE Su-wei1, 2, YAN Xiao-xu1, 2*, LIN Jia-qi1, WANG Pei-lian1, 2, LIU Jun-feng3. Spectroscopic Characteristics and Coloring Mechanism of Brown Tourmaline Under Heating Treatment[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(08): 2524-2529. |
[12] |
ZHANG Jia-lin, ZHANG Qian, PEI Jing-cheng*, HUANG Wei-zhi. Gemological and Spectroscopy Characteristics of Synthetic Blue-Green Beryl by Hydrothermal Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2258-2262. |
[13] |
DAI Jing-jing1, ZHAO Long-xian2, WANG Hai-yu2. Thermal-Infrared Spectroscopy of Garnet Minerals[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1764-1768. |
[14] |
QI Wei, FENG Peng*, WEI Biao, ZHENG Dong, YU Ting-ting, LIU Peng-yong. Feature Wavelength Optimization Algorithm for Water Quality COD Detection Based on Embedded Particle Swarm Optimization-Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 194-200. |
[15] |
MIAO Chuang-he1,2, LÜ Yi-zhong1, 2*, YU Yue1, ZHAO Kang1. Study on Adsorption Behavior of Dissolved Organic Matter Onto Soil With Spectroscopic Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(12): 3832-3838. |
|
|
|
|