Spectral Smoothing with Adaptive Multiscale Window Average
JI Jiang1, GAO Peng-fei1, JIA Nan-nan1, YANG Rui1, 2, GUO Han-ming1*, HU Qi1, ZHUANG Song-lin1
1. School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology，Shanghai 200093, China 2. Department of Medical Imaging Engineering, Shanghai Medical Instrumentation College, Shanghai 200093, China
Abstract：In order to smooth the spectra automatically and reliably, a spectral smoothing algorithm with adaptive multiscale window average (AWMA) is demonstrated. In this method, different positions of the spectra are smoothed by windows of different width, and the width of the windows will directly affect smoothing. The window with inappropriate width may cause excessive denoising (peak distortion or loss) or inadequate denoising (the flat region of the spectra still contains a lot of noise). So, how to get the right width of the window is the key of spectral smoothing. The algorithm optimized the width of windows by an iterative method, and verified whether the width is the best according to statistical Z-test. In order to increase the reliability of the algorithm, a comprehensive comparison of the thresholds of hypothesis according to simulation data of different SNR was performed. When the threshold is set to 1.1, the denoising effect can be the best. In this work, the AMWA algorithm was tested by simulated spectra and real spectra, and it can automatically adapt to different spectral shape and different noise intensity. A comprehensive comparison of AMWA smoothing, Savitzky-Golay smoothing and moving average smoothing was performed in this paper, and the AMWA algorithm is better than the other two algorithms. Results show that the AMWA algorithm not only has better denoising effect, but also has higher accuracy and fidelity. This method has achieved great effect not only to simulated spectra but also to real spectra.
[1] Fredriksson M, Petersson P, Jornten-Karlsson M, et al. Journal of Chromatography A, 2007, 1172: 135. [2] Lasch P. Chemometrics and Intelligent Laboratory Systems, 2012, 117: 100. [3] Rinnan A, Berg F V D, Engelsen S B. Trends in Analytical Chemistry, 2009, 28(10): 1201. [4] Komsta L. Analytica Chimica Acta, 2009, 641: 52. [5] Komsta L. Analytica Chimica Acta, 2009, 1216: 2548. [6] Chen D, Chen Z, Grant E. Anal. Bioanal. Chem., 2011, 400: 652. [7] Ramos P M, Ruisánchez I. Journal of Raman Spectroscopy, 2005, 36: 848. [8] Schlenke J, Hildebrand L, Moros J, et al. Analytica Chimica Acta, 2012, 754: 8. [9] lupek M, Matějka P, Volka K. Journal of Raman Spectroscopy, 2007, 38: 1174. [10] Urbas A A, Choquette S J. Society for Applied Spectroscopy, 2011, 65(6): 665. [11] Browne M, Mayer N，Cutmore T R H. Digital Signal Processing, 2007, 17: 69. [12] Schulze H G, Foist R B, Ivanov A, et al. Society for Applied Spectroscopy, 2008, 62(10): 1160. [13] Schulze H G, YU M M L, Addison C J, et al. Society for Applied Spectroscopy, 2006, 60(7): 820.
