| 光谱学与光谱分析 |
|
|
|
|
|
| Research on Spectrum Denoising Methods Based on the Combination of Wavelet Package Transformation and Mathematical Morphology |
| LI Hui1, 2, 3, LIN Qi-zhong1, 2, WANG Qin-jun1, 2, LIU Qing-jie1, 2, WU Yun-zhao4 |
1. Center for Earth Observation and Digital Earth, Chinese Academy of Sciences, Beijing 100086, China
2. Key Laboratory of Digital Earth Sciences, Chinese Academy of Sciences, Beijing 100086, China
3. Graduate University of Chinese Academy of Sciences, Beijing 100049, China
4. School of Geographic and Oceanographic Sciences of Nanjing University, Nanjing 210093, China |
|
|
|
|
Abstract The present study introduced the generalized morphological filter into the denoising of visible and near infrared spectra for the first time, and provided a new method for denoising the reflectance spectra by combining mathematical morphology methods with the wavelet packet transformation. The authors used vegetable spectra from USGS spectral library as the reference spectra, and obtained the noised spectra by adding noises with different signal-to-noise ratios to the referenced spectra. The results were evaluated by signal-to-noise ratio (SNR), root mean squared error (RMSE), normalized correlation coefficient (NCC) and smoothness ratio (SR) of the denoised spectra. The authors’ results showed that both the thresholding on wavelet packet decomposition best bases method and the generalized morphological filter method could maintain the spectral shape and the spectral smoothness after denoising. The generalized morphological filter method can remove larger amplitude random noise whereas the continuous small amplitude random noise could not be removed well. Hence, the denoised spectra were not smooth. Nevertheless, the denoised spectra using the thresholding on the best base groups of wavelet packet decomposition method were smooth, but the larger amplitude noise could not be removed completely. The authors’ method by combining the two methods has the merits of the two methods but removing their defects. The results showed that both large and small amplitude noise could be removed completely, meanwhile the normalized correlation coefficient (NCC) and smoothness ratio (SR) were improved, which indicated that the authors’ method is superior to other methods in denoising visible and near infrared spectra.
|
|
Received: 2009-06-06
Accepted: 2009-09-08
|
|
|
|
Corresponding Authors:
LI Hui
E-mail: huil064@126.com
|
|
[1] LIU Zhi-hong, DENG Bo, ZHOU Yu-rong, et al(刘志宏，邓 波，周玉荣，等). Chinese Journal of Spectroscopy Laboratory(光谱实验室), 2006, 23(4): 815.
[2] ZHANG Yin, ZHOU Meng-ran(张 银，周孟然). Infrared Technology(红外技术), 2007, 29(6): 345.
[3] Wickerhauser, Mladen Victor. INRIA Lectures on Wavelet Packet Algorithms, 1991.
[4] DU Li-zhi, YIN Kun, ZHANG Xiao-pei, et al(杜立志，殷 琨，张晓培，等). Chinese Journal of Engineering Geophysics(工程地球物理学报), 2008, 5(1): 26.
[5] DUAN Shan(段 汕). Journal of South-Central University for Nationalities·National Science Edition(中南民族大学·自然科学版), 2007, 26(2): 105.
[6] QU Guo-qing, DANG Ya-min, ZHANG Chuan-yin, et al(曲国庆，党亚民，章传银，等). Journal of Geodesy and Geodynamics(大地测量与地球动力学), 2008, 28(4): 102.
[7] Donoho D L. IEEE Transaction on Information Theory, 1995, 41(3): 613.
[8] CUI Yi(崔 屹). Image Processing and Analysis-Mathematical Morphology Methods and Applications(图像处理与分析-数学形态学方法及应用), Beijing：Science Press(北京：科学出版社), 2000.
[9] ZHANG Wen-bin, ZHOU Xiao-jun, LIN Yong(张文斌，周晓军，林 勇). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2008, 24(6).
[10] LIU Shu(刘 姝). Applying The Mathematical Morphology in Signal Processing(数学形态学在信号处理方面的应用研究). Dalian：Dalian University of Technology Press(大连：大连理工大学出版社), 2007.
[11] Zhou X, Zhou C, Kemp I J. IEEE Transactions on Dielectrics and Electrical Insulation, 2005, 12(3): 586.
[12] Tang Ju, Zhou Qian, Tang Ming, Yanbin Xie. IEEE Transactions on Dielectrics and Electrical Insulation, 2007, 14(1): 30-37.
[13] Werle P, Akbari A, Borsi H, Gockenbach E. IEEE Transactions on Electrical Insulation, 2002: 195.
[14] CHEN Qiang, HUANG Sheng-xiang, WANG Wei(陈 强，黄声享，王 韦). Journal of Geomatics(测绘信息与工程), 2008, 33(5): 31. |
| [1] |
ZHU Yan-ping1, CUI Chuan-jin1*, CHENG Peng-fei1, 2, PAN Jin-yan1, SU Hao1, 2, ZHANG Yi1. Measurement of Oil Pollutants by Three-Dimensional Fluorescence
Spectroscopy Combined With BP Neural Network and SWATLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2467-2475. |
| [2] |
CHU Zhi-hong1, 2, ZHANG Yi-zhu2, QU Qiu-hong3, ZHAO Jin-wu1, 2, HE Ming-xia1, 2*. Terahertz Spectral Imaging With High Spatial Resolution and High
Visibility[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 356-362. |
| [3] |
YANG Hua-dong1, 2, ZHU Hao1, 2, WANG Zi-chao1, 2, LIU Zhi-ang1, 2. Research on On-Line Monitoring Technology of Water Sediment
Concentration Based on Transmission Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3817-3822. |
| [4] |
WANG Zhong, WAN Dong-dong, SHAN Chuang, LI Yue-e, ZHOU Qing-guo*. A Denoising Method Based on Back Propagation Neural Network for
Raman Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1553-1560. |
| [5] |
ZHU Hong-qiu1, CHENG Fei1, HU Hao-nan1, ZHOU Can1, 2*, LI Yong-gang1. Denoising Algorithm of Spectral Signal Based on FFT SVD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 277-281. |
| [6] |
JIAO Qing-liang1, LIU Ming1*, YU Kun2, LIU Zi-long2, 3, KONG Ling-qin1, HUI Mei1, DONG Li-quan1, ZHAO Yue-jin1. Spectral Pre-Processing Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 292-297. |
| [7] |
FAN Xian-guang1, 2, 3, WU Teng-da1, ZHI Yu-liang1, WANG Xin1, 2, 3*. Denoising Method for Raman Imaging Data Based on Singular Value Decomposition and Median Absolute Deviation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 436-440. |
| [8] |
ZHENG Guo-liang, ZHU Hong-qiu*, LI Yong-gang. Spectral Signal Denoising Algorithm Based on Improved LMS[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 643-649. |
| [9] |
ZHANG Tian-tian1, LI Bing2*, CAI Gui-min2, LI Jun-hui1*, MA Yan-jun3, MA Li3, ZHAO Long-lian1, WU Shu-en2. Study on Spectral Data Processing Methods of New Type High-Density Grating Spectrometer Made in China[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2651-2656. |
| [10] |
QIU Xuan-bing1, SUN Dong-yuan1, LI Chuan-liang1*, WU Ying-fa1, ZHANG En-hua1, WEI Ji-lin1, WANG Gao2*, YAN Yu3*. Wavelet Denoising Research for the Tunable Laser Diode Absorption Spectroscopy of the CO at 1.578 μm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(02): 628-633. |
| [11] |
ZHAO Xiao-yu1, HE Yan1, ZHAI Zhe2, TONG Liang3, CAI Li-jing1, SHANG Ting-yi1. LCEEMD Adaptive Denosing Method for Raman Spectra with Low SNR[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(10): 3124-3128. |
| [12] |
JU Wei1，LU Chang-hua1, 2，ZHANG Yu-jun2，JIANG Wei-wei1，WANG Ji-zhou1，LU Yi-bing2. Open-Path Fourier Transform Infrared Spectrum De-Noising Based on Improved Threshold Lifting Wavelet Transform and Adaptive Filter[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(06): 1684-1690. |
| [13] |
SHI Ye-xin, LI Jiu-sheng*. Based on Double Threshold Canny Equalization Algorithm for Terahertz Image Enhancement[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(06): 1680-1683. |
| [14] |
LI Ying1, LI Yao-xiang1*, LI Wen-bin2, JIANG Li-chun3. Model Optimization of Wood Property and Quality Tracing Based on Wavelet Transform and NIR Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(05): 1384-1392. |
| [15] |
ZHAO Ming-fu1, 2, TANG Ping1, 2, TANG Bin1, 2, 3*, HE Peng3, XU Yang-fei1, 2, DENG Si-xing1, 2, SHI Sheng-hui1, 2. Research on Denoising of UV-Vis Spectral Data for Water Quality Detection with Compressed Sensing Theory Based on Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(03): 844-850. |
|
|
|
|
