|
|
|
|
|
|
A Denoising Method Based on Back Propagation Neural Network for
Raman Spectrum |
WANG Zhong, WAN Dong-dong, SHAN Chuang, LI Yue-e, ZHOU Qing-guo* |
School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
|
|
|
Abstract As a typical optical detective method, Raman spectroscopy has been widely used in many fields such as biological analysis, disease diagnosis and molecular recognition due to its unique non-invasive, fast, in-situ and extremely high specificity. The fingerprint characteristics of Raman Spectroscopy make it an important tool in the biomedical field. However, many problems greatly influence the application of this technology, including weak Raman scattering signal, the large dependence on analysts for data processing and analysis, and the low capabilities of automated processing. It is usually difficult to obtain an effective and stable Raman spectrum of various interference factors, including the noise from experimental equipment or environment and spontaneous fluorescence of the biological sample. All kinds of random noises will interfere with identifying fingerprint peak information in Raman spectroscopy and increase the difficulty of Raman feature extraction, so denoising is an important task in the preprocessing of Raman Spectroscopy analysis. In this paper, using the backpropagation algorithm and considering the characteristics of the data, we built the noise judgment and denoising neural network model respectively, based on the linear difference between the ideal spectral segment and the noisy spectral segment. For the simulation experiments, the data of Raman spectra are composed of a series of randomly generated mathematical models of the Lorentz peak. Different intensities of noises were added to the randomly generated single Raman spectrum and 100 groups of Raman spectra, respectively. In addition, the new method has been compared with the classic sliding window average method, Savitzky-Golay filter method, Fourier transforms, and wavelet threshold transform method. Using the Root mean square error and Signal to noise ratio indicators for analysis, the results show that all methods can complete the denoising task under low noise, but the denoising effect of the sliding window average method is obviously reduced at the edge of the spectrum. With the increase of the noise signal, the denoising performance of the sliding window average method, S-G filtering method, and Fourier transform method have all decreased significantly. Overall, the denoising method based on a backpropagation neural network is better than the Fourier transform method, sliding average window method, and S-G filter method. This method avoids complex parameter optimization settings and at the same time, obtains the denoising effect that is almost the same as the optimal wavelet transform method. It greatly simplifies the parameter setting and is more suitable for the automated denoising of the Raman spectrum.
|
Received: 2021-04-14
Accepted: 2021-08-11
|
|
Corresponding Authors:
ZHOU Qing-guo
E-mail: zhouqg@lzu.edu.cn
|
|
[1] Cicchi R, Cosci A, Rossari S, et al. J. Biophotonics, 2014. 7(1-2): 86.
[2] Lin K, Zheng W, Lim C M, et al. Biomed. Opt. Express, 2016. 7(9): 3705.
[3] McKinney S M, Sieniek M, Godbole V, et al. Nature, 2020,577(7788): 89.
[4] Schleusener J, Gluszczynska P, Reble C, et al. Exp. Dermatol., 2015, 24(10): 767.
[5] LIANG Hao-yue, CHEN Xue-lian, YANG Wan-zhu, et al(梁昊岳,程雪莲,杨晚竹,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2020,40(12): 3670.
[6] Tian Y,Burch K S. Appl. Spectrosc., 2016, 70(11): 1861.
[7] Xi Y, Li Y, Duan Z, et al. Appl. Spectrosc., 2018, 72(12): 1752.
[8] Leon-Bejarano F, Mendez M O, Ramirez-Elias M G, et al. Appl. Spectrosc., 2019, 73(12): 1436.
[9] Zhao X Y, Liu G Y, Sui Y T, et al. Spectrochim. Acta A: Mol. Biomol. Spectrosc., 2021, 250: 119374.
[10] Sun P, Shi Y, Li L, et al. International Conference on Optical Instruments and Technology-Optoelectronic Imaging/Spectroscopy and Signal Processing Technology, Beijing, 2019.
[11] Xie Junyuan, Chen Enhong. Proceedings of the 25th International Conference on Neural Information Processing Systems, 2012.
[12] Xu L, Ren J S J, Liu C, et al. Proceedings of 27th International Conference on Neural Information Processing Systems, 2014. 1790.
[13] Piriyatharawet T, Kumwilaisak W, Lasang P. 18th International Symposium on Communications and Information Technologies (ISCIT), 2018. 90.
[14] Kosko B, Audhkhasi K, Osoba O. Neural Networks, 2020, 129: 359.
[15] Kim J, Kwon D, Woo S Y, et al. Neurocomputing, 2021, 428: 153.
[16] Chen C, Wang H, Yuan F, et al. Neural Computing and Applications, 2020, 32(14): 10435.
|
[1] |
LI Jie, ZHOU Qu*, JIA Lu-fen, CUI Xiao-sen. Comparative Study on Detection Methods of Furfural in Transformer Oil Based on IR and Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 125-133. |
[2] |
WANG Fang-yuan1, 2, HAN Sen1, 2, YE Song1, 2, YIN Shan1, 2, LI Shu1, 2, WANG Xin-qiang1, 2*. A DFT Method to Study the Structure and Raman Spectra of Lignin
Monomer and Dimer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 76-81. |
[3] |
LI Xin-ting, ZHANG Feng, FENG Jie*. Convolutional Neural Network Combined With Improved Spectral
Processing Method for Potato Disease Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 215-224. |
[4] |
XING Hai-bo1, ZHENG Bo-wen1, LI Xin-yue1, HUANG Bo-tao2, XIANG Xiao2, HU Xiao-jun1*. Colorimetric and SERS Dual-Channel Sensing Detection of Pyrene in
Water[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 95-102. |
[5] |
WANG Xin-qiang1, 3, CHU Pei-zhu1, 3, XIONG Wei2, 4, YE Song1, 3, GAN Yong-ying1, 3, ZHANG Wen-tao1, 3, LI Shu1, 3, WANG Fang-yuan1, 3*. Study on Monomer Simulation of Cellulose Raman Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 164-168. |
[6] |
LAN Yan1,WANG Wu1,XU Wen2,CHAI Qin-qin1*,LI Yu-rong1,ZHANG Xun2. Discrimination of Planting and Tissue-Cultured Anoectochilus Roxburghii Based on SMOTE and Inception-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 158-163. |
[7] |
LI Hu1, ZHONG Yun1, 2, FENG Ya-ting1, LIN Zhen1, ZHU Shi-jiang1, 2*. Multi-Vegetation Index Soil Moisture Inversion Model Based on UAV
Remote Sensing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 207-214. |
[8] |
WANG Lan-hua1, 2, CHEN Yi-lin1*, FU Xue-hai1, JIAN Kuo3, YANG Tian-yu1, 2, ZHANG Bo1, 4, HONG Yong1, WANG Wen-feng1. Comparative Study on Maceral Composition and Raman Spectroscopy of Jet From Fushun City, Liaoning Province and Jimsar County, Xinjiang Province[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 292-300. |
[9] |
WANG Qi-biao1, HE Yu-kai1, LUO Yu-shi1, WANG Shu-jun1, XIE Bo2, DENG Chao2*, LIU Yong3, TUO Xian-guo3. Study on Analysis Method of Distiller's Grains Acidity Based on
Convolutional Neural Network and Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3726-3731. |
[10] |
LI Wei1, TAN Feng2*, ZHANG Wei1, GAO Lu-si3, LI Jin-shan4. Application of Improved Random Frog Algorithm in Fast Identification of Soybean Varieties[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3763-3769. |
[11] |
WANG Zhi-qiang1, CHENG Yan-xin1, ZHANG Rui-ting1, MA Lin1, GAO Peng1, LIN Ke1, 2*. Rapid Detection and Analysis of Chinese Liquor Quality by Raman
Spectroscopy Combined With Fluorescence Background[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3770-3774. |
[12] |
LIU Hao-dong1, 2, JIANG Xi-quan1, 2, NIU Hao1, 2, LIU Yu-bo1, LI Hui2, LIU Yuan2, Wei Zhang2, LI Lu-yan1, CHEN Ting1,ZHAO Yan-jie1*,NI Jia-sheng2*. Quantitative Analysis of Ethanol Based on Laser Raman Spectroscopy Normalization Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3820-3825. |
[13] |
LU Wen-jing, FANG Ya-ping, LIN Tai-feng, WANG Hui-qin, ZHENG Da-wei, ZHANG Ping*. Rapid Identification of the Raman Phenotypes of Breast Cancer Cell
Derived Exosomes and the Relationship With Maternal Cells[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3840-3846. |
[14] |
LI Qi-chen1, 2, LI Min-zan1, 2*, YANG Wei2, 3, SUN Hong2, 3, ZHANG Yao1, 3. Quantitative Analysis of Water-Soluble Phosphorous Based on Raman
Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3871-3876. |
[15] |
LUO Li, WANG Jing-yi, XU Zhao-jun, NA Bin*. Geographic Origin Discrimination of Wood Using NIR Spectroscopy
Combined With Machine Learning Techniques[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3372-3379. |
|
|
|
|