|
|
|
|
|
|
Spectral Signal Denoising Algorithm Based on Improved LMS |
ZHENG Guo-liang, ZHU Hong-qiu*, LI Yong-gang |
School of Automation, Central South University, Changsha 410083, China |
|
|
Abstract Under the high ratio of concentration, the spectral absorption signals detected by micro-spectrometer are easily disturbed by external environment and internal circuit noise. The spectral absorption signals of trace multi-metal ions are also weak and easily masked by noise, which seriously affects the accuracy and repeatability of the results of spectral quantitative analysis. Therefore, denoising of spectral absorption signal is required. However, the selection of some key detail parameters of most denoising algorithms not only needs to be tested and verified by repeated experiments, but also depends on the experience of the researchers’ experience and the characteristics of the signals. In view of the problem that these key parameters have great influence on filtering and are difficult to select, an improved LMS adaptive denoising algorithm based on sigmoid error constraints is proposed in this paper. Firstly, the principle of standard LMS algorithm is analyzed, and the standard LMS filter structure is optimized and improved in combination with the data interference of the micro spectrometer. Meanwhile, due to the characteristics with error constraints, the sigmoid function is used to optimize the error calculation module, reducing the algorithm sensitivity of noise. Then, for the improved least mean square error loss function is a nonconvex function, this paper proposes a kind of cross-entropy loss function, which transforms the nonconvex problem into a convex optimization problem. When using the gradient descent method to gradually minimize the loss function, it ensures that the local optimal solution is also the global optimal solution. The Adam algorithm is also used to adaptively adjust the learning rate factor, which ensures the fast convergence speed of the algorithm. Finally, in order to verify that the improved adaptive denoising algorithm has strong denoising performance, the proposed method is verified by cross-validation. The measured spectral absorption signals of four kinds of multi-metal ion mixed are used to test the performance of the proposed denoising method. The experimental results show thatwhen processing absorption spectrum signals with low signal-to-noise ratio (SNR), compared with the standard LMS algorithm, SG denoising algorithm, wavelet soft threshold algorithm and wavelet hard threshold algorithm, the SNR of the proposed method is increased by 9.225%, 19.678%, 7.591%, 12.042%, respectively, the mean square error of the proposed method is reduced by 59.647%, 63.070%, 53.600%, 57.793%. The proposed method can not only effectively remove the influence of irrelevant noise, but also retain some important detail features in the spectral signal, and avoid the subjective selection of parameters. In conclusion, it provides a new solution to analyze the spectral signal of low SNR.
|
Received: 2019-02-28
Accepted: 2019-06-17
|
|
Corresponding Authors:
ZHU Hong-qiu
E-mail: hqcsu@csu.edu.cn
|
|
[1] Li J, Li R, Zhao B, et al. Spectrochimica Acta Part A Molecular & Biomolecular Spectroscopy, 2018, 195: 191.
[2] Wang K, Sun D W, Wei Q, et al. LWT, 2018, 96: 66.
[3] ZHU Hong-qiu, GONG Juan, LI Yong-gang, et al(朱红求, 龚 娟, 李勇刚, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2017, 37(12): 3882.
[4] Davenport J J, Jane H, Saffell J R, et al. Applied Optics, 2015, 54(27): 8135.
[5] Ruffin C, King R L, Younan N H. GIScience & Remote Sensing, 2013, 45(1): 1.
[6] WANG Feng, ZHAO Bai-ting, JIA Xiao-fen(王 凤,赵佰亭,贾晓芬). Journal of Optoelectronics·Laser(光电子·激光),2019,8:842.
[7] LI Hong-yan, ZHOU Yun-long, TIAN Feng, et al(李红延,周云龙,田 峰,等). Chinese Journal of Scientific Instrument(仪器仪表学报),2015,36(10):2200.
[8] Narimani G, Martin P A, Taylor D P. IEEE Transactions on Communications, 2018, 66(4): 1675.
[9] Padhi T, Chandra M, Kar A, et al. Applied Acoustics, 2019, 146: 355.
[10] Lopes Pa C, Gerald Ja B, Piedade Mo S. Digital Signal Processing, 2017, 60: 75.
[11] Huang C, Xia G, Jin S, et al. Optik-International Journal for Light and Electron Optics, 2018, 157: 693.
[12] Qian Q, Jin R, Yi J, et al. Machine Learning, 2013, 99(3): 353.
[13] Elloumi S, Lambert A. Optimization Methods and Software, 2019, 34(1): 98.
[14] Kingma D P, Ba J L. ADMA: A Method for Stochastic Optimization. 2014, arXiv: 14126980[cs.LG]. |
[1] |
ZHANG Liu, ZHANG Jia-kun, LÜ Xue-ying, SONG Hong-zhen, WANG Wen-hua*. Research on Tunable Spectrum Reconstruction[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1378-1384. |
[2] |
YANG Yu-qing1, CAI Jiang-hui1, 2*, YANG Hai-feng1*, ZHAO Xu-jun1, YIN Xiao-na1. LAMOST Unknown Spectral Analysis Based on Influence Space and Data Field[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1186-1191. |
[3] |
ZHU Hong-qiu, HU Hao-nan, ZHENG Guo-liang, ZHOU Can*, LI Yong-gang. High-Quality UV-Vis Spectrum Signal Reconstruction Algorithms Based on Binary Search[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(06): 1979-1983. |
[4] |
WU Ming-lei1, PAN Jing-chang1*, YI Zhen-ping1, WEI Peng2. A Method to Search Special Stellar Spectra from Low Signal-to-Noise Ratio Spectral Sky Survey Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(02): 618-621. |
[5] |
ZHAO Xiao-yu1, HE Yan1, ZHAI Zhe2, TONG Liang3, CAI Li-jing1, SHANG Ting-yi1. LCEEMD Adaptive Denosing Method for Raman Spectra with Low SNR[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(10): 3124-3128. |
[6] |
KE Ke1, 2, Lü Yong1, 2, YI Can-can1, 2, 3*. Improvement of Convex Optimization Baseline Correction in Laser-Induced Breakdown Spectral Quantitative Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(07): 2256-2261. |
[7] |
LIU Yuan-yuan1, CHEN Jian-jun2, QIU Bo1*, FAN Xiao-dong1, WEI Shi-ya1, SONG Tao1, DUAN Fu-qing3*. A Processing Method for Low SNR Repetitive Observation Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(07): 2311-2314. |
[8] |
WANG Xin*, HE Hao, FAN Xian-guang, TANG Ming. Signal Processing Method for Raman Spectra Based on Matching Pursuit[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(01): 93-98. |
[9] |
XIE Ying-ke1,2,3, WEN Qun1,2*, WEN Zhi-yu1,2, MO Zhi-hong1,2, WEI Kang-lin1,2. On-Line Determination of Chemical Oxygen Demand and Total Phosphorus in Water by Using Fenton Reagents via a Micro-Spectrometer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(05): 1642-1648. |
[10] |
ZENG Tian-ling1, 2, WEN Zhi-yu1, 2, WEN Zhong-quan1, 2, ZHANG Zhong-wei1, 2, WEI Kang-lin3 . Research Progress in Water Quality Monitoring Technology Based on Ultraviolet Spectrum Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33(04): 1098-1103. |
[11] |
CHUAN Na1, 2, XU Yi1, 2*, CHEN Gang1, 3, WEN Zhong-quan1, 3, HE Li1, 2, WEN Zhi-yu1, 3 . Detection of Sorbic Acid in Food by Homemade Micro-Spectrometer Analytical System[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(08): 2299-2302. |
[12] |
WEI Kang-lin1, 2, 3, WEN Zhi-yu1, 2, 3*, GUO Jian1, 2, 3,CHEN Song-bo1, 2, 3 . The Design and Experiment of Multi-Parameter Water Quality Monitoring Microsystem Based on MOEMS Microspectrometer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(07): 2009-2014. |
[13] |
ZHOU Lan1, 2, MO Zhi-hong1, 2*, WEN Zhi-yu1, WEI Wen-jing1, 2 . Simultaneous Detection of Phenol and Anionic Surfactant in Water Based on Continuous Spectrum [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(05): 1316-1319. |
[14] |
WEI Kang-lin, WEN Zhi-yu*, WU Xin, ZHANG Zhong-wei, ZENG Tian-ling . Research Advances in Water Quality Monitoring Technology Based on UV-Vis Spectrum Analysis [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31(04): 1074-1077. |
[15] |
WANG Ling-fang, WEN Zhi-yu, XIANG Xian-yi. Design and Simulation of the NIR Micro-Spectrometer Optical System[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2009, 29(06): 1721-1725. |
|
|
|
|