|
|
|
|
|
|
Research on Threshold Improved Denoising Algorithm Based on Lifting Wavelet Transform in UV-Vis Spectrum |
ZHOU Feng-bo1, 3, LI Chang-geng1, ZHU Hong-qiu2* |
1. School of Physics and Electronics,Central South University,Changsha 410083,China
2. School of Information Science and Engineering,Central South University,Changsha 410083,China
3. School of Information Engineering,Shaoyang University,Shaoyang 422000,China |
|
|
Abstract In the quantitative analysis of UV-Vis spectroscopy, the random noisewhich affects the accuracy of the spectral quantitative analysis resultsseriously, is caused by spectrophotometer internal optical systems, light sources, detectors, electronic components, circuit design and external environmental interference and other factors. In order to improve the accuracy of UV-Vis spectral analysis, the spectral data need to be denoised firstly. Because wavelet analysis has the characteristics of multiresolution, low entropy and decorrelation, the denoising algorithm based on wavelet transform is superior to the traditional denoising algorithm. Currently there are threshold denoising method, coefficient correlation denoising method and modulus maxima denoising method in wavelet transform domain. In these method,the threshold denoising method proposed by Donoho is the most commonly used in engineering application. According to Donoho threshold denoising principle, this paper proposes a threshold improved algorithm based on lifting wavelet transform. On the one hand, the lifting wavelet transform is the second generation wavelet transform, inherits the multi-resolution characteristic of the wavelet transform, and does not need the Fourier transform, which has the characteristics of small computation, fast speed and simple realization. On the other hand, a new threshold function is proposed to overcome the discontinuous shortcoming in the hard threshold method and reduce the constant deviation in the soft threshold method. At the same time, the threshold estimation is adjusted to facilitate the retention of the signal wavelet coefficients and the elimination of the noise wavelet coefficients. The UV-Vis spectrum of three groups poly-metal ions were used to test the performance of the proposed denoising method. In the experiment, random noise was first added to the spectrum, and then removed by the proposed denoising method. The signal to noise ratio(SNR) and the root mean square error(RMSE) were used to evaluate the performance of the proposed denoising method. The experimental results showed that the proposed method was superior to the soft threshold method and the hard threshold method in improving SNR and decreasing RMSE, which can effectively eliminate the spectral noise and keepsome important detail features in the spectral signal. So, this proposed method is more suitable for the denoising pretreatment before the UV-Vis spectral data modeling, and will have a good application prospect in UV-Vis spectroscopic analysis.
|
Received: 2017-03-09
Accepted: 2017-08-20
|
|
Corresponding Authors:
ZHU Hong-qiu
E-mail: hqcsu@csu.edu.cn
|
|
[1] Chantzis A,Very T,Despax S,et al. Journal of Molecular Modeling,2014, 20(3): 1.
[2] Rather M A,Rather G M,Pandit S A,et al. Talanta, 2015, 131: 55.
[3] Hendel T,Wuithschick M,Kettemann F,et al. Analytical Chemistry, 2014, 86(22): 111.
[4] Castanho M A R B,Lopes S,Fernandes M,et al. Spectroscopy, 2015, 17(17): 377.
[5] Khare A, Khare M, Jeong Y, et al. Signal Processing, 2010, 90(2): 428.
[6] FEI Si,KE Ji. The Wavelet Analysis Theory and MATLAB7 Application(小波分析理论与MATLAB7实现). Beijing:Publishing House of Electronics Industry (北京:电子工业出版社),2005. 3.
[7] Shao X,Cai W, et al. Journal of Chemometrics, 2015, 12(2): 85.
[8] WANG Yu-tian,YANG Zhe,HOU Pei-guo, et al(王玉田,杨 哲,侯培国,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2016,36(7):2144.
[9] Donoho D L, et al. IEEE Trans. Inform. Theory,1995,41 (2) : 613.
[10] Xu Y S,Weaver J B,Healy D M,et al. IEEE Trans. Image Processing,1994,3(6): 747.
[11] Ding Y,Selesnick I W, et al. IEEE Signal Processing Letters, 2015, 22(9): 1364.
[12] Zhang Bo,Sun Lanxiang,Yu Haibin,et al. Spectrochimica Acta Part B,2015,107(1): 32. |
[1] |
ZHU Yan-ping1, CUI Chuan-jin1*, CHENG Peng-fei1, 2, PAN Jin-yan1, SU Hao1, 2, ZHANG Yi1. Measurement of Oil Pollutants by Three-Dimensional Fluorescence
Spectroscopy Combined With BP Neural Network and SWATLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2467-2475. |
[2] |
JU Wei1,LU Chang-hua1, 2,ZHANG Yu-jun2,JIANG Wei-wei1,WANG Ji-zhou1,LU Yi-bing2. Open-Path Fourier Transform Infrared Spectrum De-Noising Based on Improved Threshold Lifting Wavelet Transform and Adaptive Filter[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(06): 1684-1690. |
[3] |
ZHAO Ming-fu1, 2, TANG Ping1, 2, TANG Bin1, 2, 3*, HE Peng3, XU Yang-fei1, 2, DENG Si-xing1, 2, SHI Sheng-hui1, 2. Research on Denoising of UV-Vis Spectral Data for Water Quality Detection with Compressed Sensing Theory Based on Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(03): 844-850. |
[4] |
WANG Yu-tian, YANG Zhe, HOU Pei-guo*, CHENG Peng-fei, CAO Li-fang . Research on Spectroscopy Spectrum De-Noising of Mineral Oil Based on Lifting Scheme Wavelet Transform [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(07): 2144-2147. |
[5] |
YIN Lu1, 2, Bayanheshig1*, CUI Ji-cheng1, YANG Jin1, 2, ZHU Ji-wei1, YAO Xue-feng1 . An Effective Wavelength Detection Method Based on Echelle Spectra Reduction [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(03): 850-855. |
[6] |
DU Li-min1, 2, LI Jin1, 2*, JIN Guang1, GAO Hui-bin1, JIN Long-xu1, ZHANG Ke1. Compression of Interference Hyperspectral Image Based on FHALS-NTD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(11): 3155-3160. |
|
|
|
|