|
|
|
|
|
|
| Denoising Algorithm of Spectral Signal Based on FFT SVD |
| ZHU Hong-qiu1, CHENG Fei1, HU Hao-nan1, ZHOU Can1, 2*, LI Yong-gang1 |
1. School of Automation, Central South University, Changsha 410083, China
2. The State Key Laboratory of High Performance Complex Manufacturing, Changsha 410083, China |
|
|
|
|
Abstract In the process of collecting spectrum signals, the spectrum data is often interfered with by the optical system and electronic circuit of the instrument, which results in noise and characteristic peaks of the light source, and seriously interferes with the spectrum characteristic of the real spectrum signal. Therefore, it is necessary to use a reasonable preprocessing method to retain the useful signal in the spectrum signal, filter the noise signal as much as possible and filter the light source characteristic peak to improve the robustness and accuracy of the quantitative analysis of spectral information. Spectrum online detection system requires minimizing the influence of human parameter selection on the denoising effect. Singular value decomposition (SVD) is often applied to the denoising caused by the system circuit. The selection of the order of singular value denoising is very important to improve the signal-to-noise ratio. However, the selection of parameters mainly depends on empirical debugging and experimental verification. Therefore, this paper proposes a spectral signal denoising algorithm based on singular value reconstruction of signal component frequency. The algorithm firstly reconstructs the single singular value component signal of the original spectral signal. Then, the Fast Fourier Transform (FFT) of each singular value component signal is performed to obtain the frequency value corresponding to the maximum amplitude of each signal. Finally, according to the singular value decreasing mode, the first-order hysteresis difference of the corresponding component signal frequency value is carried out, and the frequency difference spectrum is obtained. The results show that the first peak value of the difference spectrum is the effective order of singular value decomposition denoising. Random noise of different intensity is added to the UV-Visible spectrum signal measured online of a solution containing a variety of metals, and the signal to noise ratio and root mean square error are compared. The results show that the proposed algorithm’s signal-to-noise ratio and root mean square error are 22.05%, 10.88% and 74.28%, 41.29% higher than those of SG filter and wavelet transform respectively. The proposed algorithm is fully data driven, which not only suppresses the noise effect in processing the real UV-Vis spectrum signal, but also effectively filters out the characteristic peak of the light source of the micro spectrometer, so it has a good application prospect in the quantitative analysis of UV-Vis spectrum signal.
|
|
Received: 2020-11-27
Accepted: 2021-03-12
|
|
|
|
Corresponding Authors:
ZHOU Can
E-mail: zhoucan@csu.edu.cn
|
|
[1] Wu Y T, Yang C E, Ko C H, et al. Chemical Engineering Journal, 2020, 393: 124700.
[2] XIA Guo, HUANG Chan, WU Su, et al(夏 果, 黄 禅, 吴 骕, 等). Acta Optica Sinica(光学学报), 2017, 37(1): 0112001.
[3] Quan X, Liu H, Lu Z, et al. Optics Communications, 2016, 359: 95.
[4] Kim D W, Hur J W, Park P G. Applied Acoustics, 2020, 158: 107031.
[5] GUO Yun-peng, ZHANG Gong, HOU Zhi-cheng, et al(郭云鹏, 张 弓, 侯至丞, 等). Process Automation Instrumentation(自动化仪表), 2019, 40(2): 30.
[6] Dai X, Cheng L Z, Mareschal J C, et al. Journal of Applied Geophysics, 2019, 168: 41.
[7] Tǎnǎsescu A, Popescu P G. Journal of Computational Science, 2019, 31: 1.
[8] ZHANG Ying, YIN Hong, PENG Zhen-rui(张 莹, 殷 红, 彭珍瑞). Noise and Vibration Control(噪声与振动控制), 2020, 40(1): 51.
[9] ZHAO Xue-zhi, YE Bang-yan, CHEN Tong-jian(赵学智, 叶邦彦, 陈统坚). Journal of Mechanical Engineering(机械工程学报), 2010, 46(1): 100.
[10] DAI Dang-dang, WANG Xian-pei, ZHAO Yu, et al(代荡荡, 王先培, 赵 宇, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2016, 36(7): 2139.
[11] Zheng Y, Guo X, Jiang H, et al. Biomedical Signal Processing and Control, 2017, 38: 34. |
| [1] |
CHEN Chao-yang1, 2, LIU Cui-hong1, 2, LI Zhi-bin3, Andy Hsitien Shen1, 2*. Alexandrite Effect Origin of Gem Grade Diaspore[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2557-2562. |
| [2] |
ZHU Wei1, 2, YANG Rui-fang1*, ZHAO Nan-jing1*, YIN Gao-fang1, XIAO Xue1, LIU Jian-guo1, LIU Wen-qing1. Study on Small Sample Analysis Method for Identification of Polycyclic Aromatic Hydrocarbons in Water[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3494-3500. |
| [3] |
WANG Zhong, WAN Dong-dong, SHAN Chuang, LI Yue-e, ZHOU Qing-guo*. A Denoising Method Based on Back Propagation Neural Network for
Raman Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1553-1560. |
| [4] |
JIAO Qing-liang1, LIU Ming1*, YU Kun2, LIU Zi-long2, 3, KONG Ling-qin1, HUI Mei1, DONG Li-quan1, ZHAO Yue-jin1. Spectral Pre-Processing Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 292-297. |
| [5] |
JIA Gui-hong1, 2*, ZHANG Jian-jun1, ZHENG Hai-ming2. Research on FFT+FT Spectrum Zooming Method for Differential Optical Absorption Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2116-2121. |
| [6] |
HAN Qian-qian, YANG Ke-ming*, LI Yan-ru, GAO Wei, ZHANG Jian-hong. SVD-ANFIS Model for Predicting the Content of Heavy Metal Lead in Corn Leaves Using Hyperspectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1930-1935. |
| [7] |
CHEN Chao-yang1, HUANG Wei-zhi1, GAO Qiang2, FAN Lu-wei3, Andy Hsitien Shen1*. Assignments on Raman Peaks of Red Coral Based on Experimental Raman Spectroscopy and Density Functional Theory Calculation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 127-130. |
| [8] |
YAN Fan1, ZHU Qi-bing1*, HUANG Min1, LIU Cai-zheng1, LEI Ze-min2, ZHANG Heng2, ZHANG Li-wen2，LI Min2. Quantitative Analysis Method for Mixture With Known Components Based on Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(11): 3599-3605. |
| [9] |
LIAO Wang-chun1, FAN Xing-yu2, SHI Guang-hai3*, DAI Li-li4. Study on Chemical Process of Amber Formation by Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(10): 3167-3173. |
| [10] |
FAN Xian-guang1, 2, 3, WU Teng-da1, ZHI Yu-liang1, WANG Xin1, 2, 3*. Denoising Method for Raman Imaging Data Based on Singular Value Decomposition and Median Absolute Deviation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 436-440. |
| [11] |
CHEN Chao-yang1, HUANG Wei-zhi1, SHAO Tian1, SHEN Che1, LI Zhi-bin2, Andy Hsitien Shen1*. The Study on UV-Vis Spectrum of a Special Color-Changed Sapphire[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2470-2473. |
| [12] |
LIU Chun-tong, MA Shi-xin*, WANG Hao, WANG Yang, LI Hong-cai. A Density-Based Cluster Kernel RX Algorithm for Hyperspectral Anomaly Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(06): 1878-1884. |
| [13] |
XU Li-peng1, 2, GE Liang-quan1*, DENG Xiao-qin2, CHEN Li2, ZHAO Qiang2, LI Bin2, WANG Liang2. Research of Carborne γ-Ray Energe Spectrum Radiation Dose Rate Based on FFT-BP Network Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(02): 590-594. |
| [14] |
ZHU Gao-feng1，2, YANG Chun-hua1, ZHU Hong-qiu1*, GUI Wei-hua1. Oxygen Concentration Detection and Calibration Method Improvement in Pharmaceutical Vial Based on Wavelength Modulation Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(10): 3133-3137. |
| [15] |
YANG Xi1, 2, HUANG Hong-quan1, 2*, JIANG Kai-ming1, CHEN Wen-de1, ZHOU Wei1, WANG Man-man1. Application of Particle Swarm Algorithm and GMM-SDR Model in Overlapping Spectrum Peak Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(08): 2376-2380. |
|
|
|
|
