摘要: 针对目前近红外光谱分析中模型传递现有方法的局限性,文章介绍了一种简便的近红外光谱标准化方法,并构造了一种新的光谱标准化误差指标(spectra standard error,SSE)作为评价传递结果的指标。SSE为J2和J1的比值,这里,J2表示同一样本在不同仪器上测得的谱线的距离,J1表示目标机的不同样本相对中心谱线的平均距离。文章首先对不同光谱仪所测得的吸光度谱图进行多项式卷积平滑处理以去除基线,接着采用标准归一法以实现谱图的标准化,并采用多项式卷积滤波以去除噪声。为使SSE达到最小,在处理过程中可进行波长范围和卷积窗口宽度的优化。经过上述处理后的标准化谱图可用于光谱建模分析。该方法不需要预先获得大量样本,也不需要将同一样本在不同光谱仪上测得的谱图进行比较。针对一批汽油样本的试验结果表明,借助于此方法可使SSE从1.418下降至0.167,谱图标准化效果令人满意。
关键词:近红外光谱;光谱标准化误差指标;预处理;模型传递;波长选择;汽油辛烷值
Abstract:Due to the limitation of current algorithms for NIR spectral analysis model transfer, a simple and convenient algorithm to standardize the spectra was proposed, and a new performance index called spectra standard error (SSE) was also constructed to evaluate the validity of model transfer algorithms. SSE expresses the ratio of J2 to J1, where J2 describes the distances between the spectra of the same sample using different instruments, and J2 describes the average distance between the spectra of different samples using the original instrument for their central spectrum. In the present paper we first used Savitzky-Golay smoothing to realize baseline correction for different spectra, and then applied standard normal variate method to standardize spectra and polynomial filtering to avoid noise. Besides, we optimized the wavelength range and the window width in Savitzky-Golay smoothing in order to minimize the SSE. After these steps, the standardized spectra can be applied to spectral analysis modeling. By the new algorithm, neither collecting a great number of samples nor need measuring all spectra of training samples using different instruments are needed. For a set of gasoline samples, SSE can be reduced from 1.418 to 0.167 via the new standardization algorithm and satisfactory results were obtained.
Key words:NIR spectra;Spectra standard error;Preprocessing;Model transfer;Wavelength selection;Gasoline octane number
包鑫,戴连奎*. 一种简便的近红外光谱标准化方法[J]. 光谱学与光谱分析, 2008, 28(04): 829-833.
BAO Xin,DAI Lian-kui*. A Simple and Convenient Standardization Algorithm of NIR Spectra. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2008, 28(04): 829-833.
[1] SHI Yu-zhen, CHEN Zhi-chun, LIN Xian-fu(施玉珍, 陈志春, 林贤福). Chinese Journal of Analytical Chemistry(分析化学) , 2005, 33(2):272. [2] Bergman E L, Brage H, Josefson M, et al. Journal of Pharmaceutical and Biomedical Analysis, 2006, 41(1): 89. [3] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立, 袁洪福, 陆婉珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2001, 21(6): 881. [4] Wang Y D,Veltkamp D J,Kowalski B R. Analytical Chemistry,1991,63: 1991. [5] Noordm O E. Chemometrics and Intelligent Laboratory Systems, 1994, 25: 85. [6] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立, 袁洪福, 陆婉珍). Chinese Journal of Analytical Chemistry(分析化学), 2002, 30(1):114. [7] WU Zhong-chen, XU Xiao-xuan, YANG Ren-jie, et al(武中臣, 徐晓轩, 杨仁杰, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2005, 25(12): 1975. [8] Park K S, Ko Y H, Lee H, et al. Chemometrics and Intelligent Laboratory Systems, 2001, 55(13):53. [9] Sjoblom J, Svensson O, Josefson M, et al. Chemometrics and Intelligent Laboratory Systems, 1998, 44(14): 229. [10] ZHANG Lin, ZHANG Li-ming, LI Yan, et al(张 琳, 张黎明, 李 燕, 等). Chinese Journal of Analytical Chemistry(分析化学), 2005, 33(12): 1709. [11] Blank T B, Sum S T, Brown S D. Analytical Chemistry,1996,68:2987. [12] Bouveresse E, Massart D L. Chemometrics and Intelligent Laboratory Systems, 1996, 32(2): 201. [13] LU Wan-zhen, YUAN Hong-fu, XU Guang-tong, et al(陆婉珍,袁洪福,徐广通,等). Modern Analytical Techniques in Near-Infrared Spectroscopy(现代近红外光谱分析技术). Beijing:China Petrochemical Press(北京:中国石化出版社),2000. 193. [14] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立,袁洪福,陆婉珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2005,25(6):886. [15] Kelly J J, Barlow C H, Jinguji T M, et al. Analytical Chemistry, 1989, 61: 313. [16] WU Yan-ping, LI Guo-liang, LU Wan-zhen, et al(吴艳萍,李国梁,陆婉珍,等). Petroleum Processing and Petrochemicals(石油炼制与化工),2002,33(5):57. [17] ZHANG Qi-ke, DAI Lian-kui(张其可,戴连奎). Journal of Transduction Technology(传感技术学报),2006,19(4):1190. [18] TIAN Gao-you, YUAN Hong-fu, CHU Xiao-li, et al(田高友,袁洪福,褚小立,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2005,25(4):516.