|
|
|
|
|
|
Denoising Method for Raman Imaging Data Based on Singular Value Decomposition and Median Absolute Deviation |
FAN Xian-guang1, 2, 3, WU Teng-da1, ZHI Yu-liang1, WANG Xin1, 2, 3* |
1. Department of Instrumental and Electrical Engineering, School of Aerospace Engineering, Xiamen University, Xiamen 361005, China
2. Fujian Key Laboratory of Universities and Colleges for Transducer Technology, Xiamen 361005, China
3. Xiamen Key Laboratory of Optoelectronic Transducer Technology, Xiamen 361005, China |
|
|
Abstract Raman imaging is a noninvasive, marker-free spectral imaging technique that provides molecular fingerprinting and spatial distribution of different components of a sample, and is more important than other imaging techniques. However, the Raman scattering has a small cross-sectional area and low sensitivity. In addition, in many experiments, in order to observe the dynamic distribution of certain components, the scanning time is shortened, and the resulting imaging data are disturbed by noise, so it is often necessary to denoise the signal. Conventional algorithms generally process the spectrum based on a given mathematical model, which is likely to cause excessive filtering and distortion of the signal. In addition, when processing Raman imaging data, conventional algorithms tend to denoise the data one by one. This neglects the relationship between multiple spectra, resulting in the final Raman image still being disturbed by many noises. Therefore, a signal processing method based on singular value decomposition (SVD) and median absolute deviation (MAD) is proposed for denoising Raman imaging data. Firstly, the singular value decomposition is performed on the Raman imaging data to obtain a singular value matrix and two orthogonal matrices. Then, all singular values in the singular value matrix are detected by the median absolute deviation method. The consecutively labeled outliers are used as singular values to be preserved, and the remaining singular values are assigned to zero to obtain a new singular value matrix. Finally, the new singular value matrix and two orthogonal matrices are solved again to obtain a denoised Raman imaging data. In the experiment, we first verify the correctness of the median absolute deviation method in determining the k value, and then the proposed algorithm is compared with the conventional algorithm from the aspects of image quality and signal waveform. The results show that the median absolute deviation method can quickly determine a reasonable value, and the imaging data processed according to this value not only eliminate a lot of noise in the imaging quality, but also make the spatial distribution characteristics of the components clearly visible. The tiny peaks are also perfectly preserved on the signal waveform and the spectral signal is recovered. This algorithm is different from the conventional algorithm in that it can process the entire Raman imaging data at the same time and preserve the statistical features between the spectra. It is a more effective denoising method for Raman imaging data.
|
Received: 2018-12-09
Accepted: 2019-04-16
|
|
Corresponding Authors:
WANG Xin
E-mail: xinwang@xmu.edu.cn
|
|
[1] HU Xiao-hong, ZHOU Jin-chi(胡晓红,周金池). Analytical Instrumentation(分析仪器), 2011, 6: 1.
[2] Schafer R W. IEEE Signal Processing Magazine, 2011, 28(4): 111.
[3] ZHAO Ming-fu, TANG Ping, TANG Bin, et al(赵明富,唐 平,汤 斌,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2018, 38(3): 844.
[4] Srivastava M, Anderson C L, Freed J H. IEEE Access, 2016, 4: 3862.
[5] Ghaderyan P, Abbasi A, Saber S, et al. Expert Systems with Applications, 2018, 114: 428.
[6] ZHANG Xian-da(张贤达). Matrix Analysis and Applications(矩阵分析与应用). Beijing: Tsinghua University Press(北京:清华大学出版社), 2013. 288.
[7] Ahmad F M, Shen R, Zaheer A B, et al. Meteorology and Atmospheric Physics, 2018, 130(6): 689.
[8] Feng Liang, Zhou Cangqi, Zhao Qianchuan. Physica A-Statistical Mechanics and Its Applications, 2019, 513: 424.
[9] Prakash N, Ramachandran A, Varma R, et al. Analyst, 2018, 143(14): 3284.
[10] Aydin D. Wind and Structures, 2018, 26(6): 383.
[11] Leys C, Ley C, Klein O, et al. Journal of Experimental Social Psychology, 2013, 49(4): 764.
[12] Kumar K S, Yazdanpanah B, Kumar P R. International Conference on Communications and Signal Processing, 2015, 4: 157. |
[1] |
ZHU Yan-ping1, CUI Chuan-jin1*, CHENG Peng-fei1, 2, PAN Jin-yan1, SU Hao1, 2, ZHANG Yi1. Measurement of Oil Pollutants by Three-Dimensional Fluorescence
Spectroscopy Combined With BP Neural Network and SWATLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2467-2475. |
[2] |
CHENG Xiao-xiang1, WU Na2, LIU Wei2*, WANG Ke-qing2, LI Chen-yuan1, CHEN Kun-long1, LI Yan-xiang1*. Research on Quantitative Model of Corrosion Products of Iron Artefacts Based on Raman Spectroscopic Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2166-2173. |
[3] |
CHU Zhi-hong1, 2, ZHANG Yi-zhu2, QU Qiu-hong3, ZHAO Jin-wu1, 2, HE Ming-xia1, 2*. Terahertz Spectral Imaging With High Spatial Resolution and High
Visibility[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 356-362. |
[4] |
YANG Hua-dong1, 2, ZHU Hao1, 2, WANG Zi-chao1, 2, LIU Zhi-ang1, 2. Research on On-Line Monitoring Technology of Water Sediment
Concentration Based on Transmission Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3817-3822. |
[5] |
ZHU Wei1, 2, YANG Rui-fang1*, ZHAO Nan-jing1*, YIN Gao-fang1, XIAO Xue1, LIU Jian-guo1, LIU Wen-qing1. Study on Small Sample Analysis Method for Identification of Polycyclic Aromatic Hydrocarbons in Water[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3494-3500. |
[6] |
WANG Zhong, WAN Dong-dong, SHAN Chuang, LI Yue-e, ZHOU Qing-guo*. A Denoising Method Based on Back Propagation Neural Network for
Raman Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1553-1560. |
[7] |
FAN Xian-guang1, 2, HUANG Yan-rui1, LIU Long1, XU Ying-jie1, WANG Xin1, 2*. An Interpolation Method for Raman Imaging Using Voigt Function[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1478-1483. |
[8] |
ZHU Hong-qiu1, CHENG Fei1, HU Hao-nan1, ZHOU Can1, 2*, LI Yong-gang1. Denoising Algorithm of Spectral Signal Based on FFT SVD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 277-281. |
[9] |
JIAO Qing-liang1, LIU Ming1*, YU Kun2, LIU Zi-long2, 3, KONG Ling-qin1, HUI Mei1, DONG Li-quan1, ZHAO Yue-jin1. Spectral Pre-Processing Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 292-297. |
[10] |
WANG Xiao-bin1, 2, 3, ZHANG Xi1, GUAN Chen-zhi1, HONG Hua-xiu1, HUANG Shuang-gen2*, ZHAO Chun-jiang3. Quantitative Detection of Ascorbic Acid Additive in Flour Based on Raman Imaging Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(12): 3765-3770. |
[11] |
ZHANG Tie-zhu1, 2, ZHANG Yu-xuan2, 3, LIU Sai-yu2, 4, LI Hang-ren2, XU Wen-ce1, 2, ZHANG Jin-shan1*, OUYANG Shun-li2*, WU Nan-nan4. The Occurrence and Distribution of REE Minerals in Fluorite-Type Ores in Bayan Obo:Constraints From Raman Mapping[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(12): 3776-3781. |
[12] |
HAN Qian-qian, YANG Ke-ming*, LI Yan-ru, GAO Wei, ZHANG Jian-hong. SVD-ANFIS Model for Predicting the Content of Heavy Metal Lead in Corn Leaves Using Hyperspectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1930-1935. |
[13] |
FAN Xian-guang1, 2, LIU Long1, ZHI Yu-liang1, KANG Zhe-ming1, XIA Hong1, ZHANG Jia-jie1, WANG Xin1, 2*. Fast Reconstruction for Multi-Channel Raman Imaging Based on and Sample Optimization and PCA[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(08): 2495-2499. |
[14] |
XI Yang, LI Yue-e*. A Novel Interpolation Method for Raman Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 410-414. |
[15] |
ZHENG Guo-liang, ZHU Hong-qiu*, LI Yong-gang. Spectral Signal Denoising Algorithm Based on Improved LMS[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 643-649. |
|
|
|
|