光谱学与光谱分析 |
|
|
|
|
|
Spectral Smoothing with Adaptive Multiscale Window Average |
JI Jiang1, GAO Peng-fei1, JIA Nan-nan1, YANG Rui1, 2, GUO Han-ming1*, HU Qi1, ZHUANG Song-lin1 |
1. School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology,Shanghai 200093, China 2. Department of Medical Imaging Engineering, Shanghai Medical Instrumentation College, Shanghai 200093, China |
|
|
Abstract In order to smooth the spectra automatically and reliably, a spectral smoothing algorithm with adaptive multiscale window average (AWMA) is demonstrated. In this method, different positions of the spectra are smoothed by windows of different width, and the width of the windows will directly affect smoothing. The window with inappropriate width may cause excessive denoising (peak distortion or loss) or inadequate denoising (the flat region of the spectra still contains a lot of noise). So, how to get the right width of the window is the key of spectral smoothing. The algorithm optimized the width of windows by an iterative method, and verified whether the width is the best according to statistical Z-test. In order to increase the reliability of the algorithm, a comprehensive comparison of the thresholds of hypothesis according to simulation data of different SNR was performed. When the threshold is set to 1.1, the denoising effect can be the best. In this work, the AMWA algorithm was tested by simulated spectra and real spectra, and it can automatically adapt to different spectral shape and different noise intensity. A comprehensive comparison of AMWA smoothing, Savitzky-Golay smoothing and moving average smoothing was performed in this paper, and the AMWA algorithm is better than the other two algorithms. Results show that the AMWA algorithm not only has better denoising effect, but also has higher accuracy and fidelity. This method has achieved great effect not only to simulated spectra but also to real spectra.
|
Received: 2014-03-28
Accepted: 2014-06-14
|
|
Corresponding Authors:
GUO Han-ming
E-mail: hmguo@usst.edu.cn
|
|
[1] Fredriksson M, Petersson P, Jornten-Karlsson M, et al. Journal of Chromatography A, 2007, 1172: 135. [2] Lasch P. Chemometrics and Intelligent Laboratory Systems, 2012, 117: 100. [3] Rinnan A, Berg F V D, Engelsen S B. Trends in Analytical Chemistry, 2009, 28(10): 1201. [4] Komsta L. Analytica Chimica Acta, 2009, 641: 52. [5] Komsta L. Analytica Chimica Acta, 2009, 1216: 2548. [6] Chen D, Chen Z, Grant E. Anal. Bioanal. Chem., 2011, 400: 652. [7] Ramos P M, Ruisánchez I. Journal of Raman Spectroscopy, 2005, 36: 848. [8] Schlenke J, Hildebrand L, Moros J, et al. Analytica Chimica Acta, 2012, 754: 8. [9] lupek M, Matějka P, Volka K. Journal of Raman Spectroscopy, 2007, 38: 1174. [10] Urbas A A, Choquette S J. Society for Applied Spectroscopy, 2011, 65(6): 665. [11] Browne M, Mayer N,Cutmore T R H. Digital Signal Processing, 2007, 17: 69. [12] Schulze H G, Foist R B, Ivanov A, et al. Society for Applied Spectroscopy, 2008, 62(10): 1160. [13] Schulze H G, YU M M L, Addison C J, et al. Society for Applied Spectroscopy, 2006, 60(7): 820. |
[1] |
WANG Cai-ling1,ZHANG Jing1,WANG Hong-wei2*, SONG Xiao-nan1, JI Tong3. A Hyperspectral Image Classification Model Based on Band Clustering and Multi-Scale Structure Feature Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 258-265. |
[2] |
FU Peng-you1, 2, WEN Yue2, ZHANG Yu-ke3, LI Ling-qiao1*, YANG Hui-hua1, 2*. Deep Learning Modelling and Model Transfer for Near-Infrared Spectroscopy Quantitative Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 310-319. |
[3] |
XU Xue-bin1, 2, XING Xiao-min1, 2*, AN Mei-juan1, 2, CAO Shu-xin1, 2, MENG Kan1, 2, LU Long-bin1, 2. Palmprint Recognition Method Based on Multispectral Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3615-3625. |
[4] |
YU Guo-wei1, MA Ben-xue1,2*, CHEN Jin-cheng1,3, DANG Fu-min4,5, LI Xiao-zhan1, LI Cong1, WANG Gang1. Vis-NIR Spectra Discriminant of Pesticide Residues on the Hami Melon Surface by GADF and Multi-Scale CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(12): 3701-3707. |
[5] |
GONG Yue-hong1, YANG Tie-jun2*, LIANG Yi-tao1, 3, GE Hong-yi1, 3. Fast and Non-Destructive Determination on Fresh Degree of Wheat Kernels Based on Biophotons[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2166-2170. |
[6] |
PAN Zhao1, LI Rui-hang1, WU Xi-jun1*, CUI Yao-yao2. Simple and Quick Identification of Adulterated Sesame Oil by Wavelet Moments and Three-Dimensional Fluorescence Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(05): 1547-1553. |
[7] |
LIN Su-zhen, WANG Dong-juan, WANG Xiao-xia, ZHU Xiao-hong. Multi-Band Texture Image Fusion Based on the Embedded Multi-Scale Decomposition and Possibility Theory[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(07): 2337-2343. |
[8] |
GAO Peng-fei1, YANG Rui1, 2, JI Jiang1, GUO Han-ming1*, HU Qi1, ZHUANG Song-lin1 . Locally Dynamically Moving Average Algorithm for the Fully Automated Baseline Correction of Raman Spectrum [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(05): 1281-1285. |
[9] |
XIA Jun1,2, TASHPOLAT·Tiyip1,2*, MAMAT·Sawut1,2, ZHANG Fei1,2, HAN Gui-hong1,2 . Application Study of the Thermal Infrared Emissivity Spectra in the Estimation of Salt Content of Saline Soil[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(11): 2956-2961. |
[10] |
PENG Xi1, WANG Xian-pei1, HUANG Yun-guang2 . Infrared Spectroscopy Analysis of SF6 Using Multiscale Weighted Principal Component Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(06): 1535-1540. |
[11] |
DU Shuang-yu, WANG Xian-pei, CAI Tao, YANG Jie . Research on Infrared Spectrum Intercomparison Search Method Based on Wavelet Multi-Scale Decomposition [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31(05): 1262-1265. |
[12] |
LI Hui1, 2, 3, LIN Qi-zhong1, 2, WANG Qin-jun1, 2, LIU Qing-jie1, 2, CHEN Yu1, 3 . A Novel Hyperspectra Absorption Enhancing Method Based on Morphological Top-Hat Transformation [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2010, 30(09): 2433-2437. |
[13] |
PENG Dan, XU Ke-xin*, LI Chen-xi. Application of Wavelet Multi-Scale Orthogonal Signal Correction in Milk Components Measurement Using Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2008, 28(04): 825-828. |
|
|
|
|