|
|
|
|
|
|
An Adaptive Hierarchical Savitzky-Golay Spectral Filtering Algorithm and Its Application |
LU Yi-bing1, 2, LIU Wen-qing1, 2, ZHANG Yu-jun1, 2*, ZHANG Kai1, 2, HE Ying1, 2, YOU Kun1, 2, LI Xiao-yi1, LIU Guo-hua1, 2, TANG Qi-xing1, 2, FAN Bo-qiang1, 2, YU Dong-qi1, 2, LI Meng-qi1, 2 |
1. Key Laboratory of Environmental Optics & Technology, Anhui Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Hefei 230031, China
2. University of Science and Technology of China, Science Island Branch of Graduate School, Hefei 230026, China |
|
|
Abstract The tunable diode laser absorption spectroscopy (TDLAS) has the narrow linewidth characteristic of tunable diode lasers, so the gas concentration measurement of high precision and selectivity can be achieved by selecting the single absorption line of the specific gas to eliminate the interference of other gases, which has wide applications in the gas concentration detection. However, under different application conditions and environments, the people need to solve corresponding technical problems in hardware and data processing. In this paper, the TDLAS spectral data processing problem in the telemetry system for the vehicle exhaust CO concentration has been mainly studied. The system telemetered the exhaust CO concentration of the driving vehicle with the echo signals from the road diffuse reflection. Because the echo signal of laser scanning spectral is affected by factors such as the variation of the diffuse reflection surface, the change of the air environment, and the influence of exhaust turbulence, the signal collected by the detector is not only weak but also mixed with various noises, which means the SNR of the measured optical path is comparatively weak, so an adaptive hierarchical Savitzky-Golay (S-G) smoothing filter algorithm has been proposed in this paper, which can realize the spectral filtering processing to inversion the CO concentration more accurately. The S-G filtering algorithm has been widely used in spectral processing due to its advantages of such as simple principles, powerful functions and only two parameters setting (the window size and the fitting order). But how to set the parameters of the S-G algorithm correctly to balance the filtering effect between insufficient denoising and excessive filtering is a big problem for its application. In the designed detection system, the spectral signal of the measured optical path is non-stationary signal, and the amplitudes of the noises and effective signals are time-varying. So the optimal window size and polynomial order are changing with the signal dynamics of large range. As a result, it’s difficult to achieve the optimal filtering effect through S-G filters with fixed parameters. With the adaptive hierarchical S-G smoothing filter algorithm proposed in this paper, the sum of the signal correlation coefficient and the first derivative of the signal from measured light path spectrum signal after S-G filtering layer by layer and the reference section set by the spectrum signal of the reference light path have been compared, and then the optimal parameters of each layer can be obtained adaptively. With the analysis on 10 groups of band noise spectrum of which the signal to noise ratios(SNR) are from 9.81 to 29.77, the algorithm could effectively restore the concentration information carried by the band noise signals of the gas to be measured. Compared with the band noise spectrum, the maximum error of the absorption spectrum peak has dropped from 25.152% to 5.917%, and the maximum error of the integral absorbance has decreased from 18.1% to 3.9%. In the realized system, the adaptive algorithm has been used for the filtering processing of the measured optical path. The CO concentration emitted by motor vehicles of different models, displacement and oil product use has been monitored online in real time when they passed the system at idle and low speed(5 km·h-1).
|
Received: 2018-08-24
Accepted: 2018-12-30
|
|
Corresponding Authors:
ZHANG Yu-jun
E-mail: yjzhang@aiofm.ac.cn
|
|
[1] TANG Yuan-yuan, LIU Wen-qing, KAN Rui-feng, et al(汤媛媛,刘文清,阚瑞峰,等). Chinese Journal of Lasers(中国激光), 2011, 38(12): 221.
[2] Chen C, Zhang Y J, He Y. Infrared Technology, 2017, 39(6): 567.
[3] Arimoto H, Takeuchi N, Mukaihara S, et al. International Journal of Technology,2011,2(1):9.
[4] Vivó-Truyols G, Schoenmakers P J. Analytical Chemistry, 2006, 78(13): 4598.
[5] Phillip Barak. Analytical Chemistry, 1995, 67(17): 2758.
[6] GAO Yan-wei, ZHANG Yu-jun, CHEN Dong, et al(高彦伟,张玉钧,陈 东,等). Acta Optica Sinica(光学学报), 2016, 36(3): 0330001.
[7] YAO Lu, LIU Wen-qing, LIU Jian-guo, et al(姚 路,刘文清,刘建国,等). Chinese Journal of Lasers(中国激光), 2015, 42(2): 305.
[8] Savitzky A, Golay M J E. Anal. Chem.,1964,36:1627. |
[1] |
WANG Yan-ru, TANG Hai-jun*, ZHANG Yao. Study on Infrared Spectral Detection of Fuel Contamination in Mobil Jet Oil II Lubricating Oil[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1541-1546. |
[2] |
DU Bao-lu, LI Meng, GUO Jin-jia*, ZHANG Zhi-hao, YE Wang-quan, ZHENG Rong-er. The Experimental Research on In-Situ Detection for Dissolved CO2 in
Seawater Based on Tunable Diode Laser Absorption Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1264-1269. |
[3] |
QU Li-guo1,2,3, LIU Jian-guo1, XU Liang1*, XU Han-yang1, JIN Ling1, DENG Ya-song1,2, SHEN Xian-chun1, SHU Sheng-quan1,2. Vehicle Exhaust Detection Method Based on Portable FTIR[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1751-1757. |
[4] |
LIU You-fu, XIAO De-qin*, WANG Chun-tao. Fertilized Eggs’ Air-Cell Change Monitoring Algorithm Based on Thermal-Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(02): 572-578. |
[5] |
WANG Zi-jun1, 2, LUO Yuan-yi1, 2*, JIANG Shang-zhi1, 2, XIONG Nan-fei1, 2, WAN Li-tao1, 2. An Improved Algorithm for Adaptive Infrared Image Enhancement Based on Guided Filtering[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(11): 3463-3467. |
[6] |
CUI Shuang-long, SUN Bo-jun, SUN Xiao-gang*. Universal Formula of Blackbody Waveband Radiation Brightness Response in the Infrared Temperature Measurement Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(05): 1329-1333. |
[7] |
XIANG Zi-han1, YIN Zuo-wei1,2*, ZHENG Xiao-hua2. The Characterization Study on Quantity of Filled Glass Material in Ruby[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(04): 1274-1279. |
[8] |
JU Wei1,LU Chang-hua1, 2,ZHANG Yu-jun2,JIANG Wei-wei1,WANG Ji-zhou1,LU Yi-bing2. Open-Path Fourier Transform Infrared Spectrum De-Noising Based on Improved Threshold Lifting Wavelet Transform and Adaptive Filter[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(06): 1684-1690. |
[9] |
ZHANG Jian1, 2, MENG Jin1, 2, ZHAO Bi-quan1, 2, ZHANG Dong-yan3, XIE Jing4*. Research on the Chlorophyll Content (SPAD) Distribution Based on the Consumer-Grade Modified Near-Infrared Camera[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(03): 737-744. |
[10] |
XIAO Bo-cheng1, LIU Jun-yan2*. Experimental Study on Sensitivity of In-Vitro Caries Detection with Thermophotonic Lock-in Imaging (TPLI)[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(03): 933-940. |
[11] |
LI Xiao-jing, YU Lan, ZU En-dong*. Application of Near Infrared Spectroscopy in the Study of Gems[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(01): 54-57. |
[12] |
ZHANG Jian1, LI Yong1, XIE Jing2*, LI Zong-nan1. Research on Optimal Near-Infrared Band Selection of Chlorophyll (SPAD) 3D Distribution about Rice Plant[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(12): 3749-3757. |
[13] |
MA Yu-ting1,2, ZHANG Jin1, SHI Chang-cheng2*, LI Wei2, HAN Xiao-hui1, PENG Xiao-yu2, WEI Dong-shan2, DU Chun-lei2, CUI Hong-liang1,2*. Current Status and Recent Advances in Research and Application of THz Technology in Articular Cartilage Detection [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(07): 2031-2035. |
[14] |
ZHANG Min-juan3, WANG Zhi-bin1, 2, 3, LI Xiao3, LI Jin-hua3, WANG Yan-chao3 . The Stability and Measuring Technology of the Maximum Optical Path Difference of Photo-Elastic Modulator Interferograms [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(05): 1436-1439. |
[15] |
TU Zhi-hua1, ZHAO Yang2, ZHENG Li-wen1, JIA Guo-dong1, CHEN Li-hua1, YU Xin-xiao1* . Detection of Carbon Dioxide Concentration in Soil Profile Based on Nondispersive Infrared Spectroscopy Technique[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(04): 997-1000. |
|
|
|
|