光谱学与光谱分析 |
|
|
|
|
|
A Simple and Convenient Standardization Algorithm of NIR Spectra |
BAO Xin,DAI Lian-kui* |
National Key Lab of Industrial Control Technology, Zhejiang University, Hangzhou 310027, China |
|
|
Abstract Due to the limitation of current algorithms for NIR spectral analysis model transfer, a simple and convenient algorithm to standardize the spectra was proposed, and a new performance index called spectra standard error (SSE) was also constructed to evaluate the validity of model transfer algorithms. SSE expresses the ratio of J2 to J1, where J2 describes the distances between the spectra of the same sample using different instruments, and J2 describes the average distance between the spectra of different samples using the original instrument for their central spectrum. In the present paper we first used Savitzky-Golay smoothing to realize baseline correction for different spectra, and then applied standard normal variate method to standardize spectra and polynomial filtering to avoid noise. Besides, we optimized the wavelength range and the window width in Savitzky-Golay smoothing in order to minimize the SSE. After these steps, the standardized spectra can be applied to spectral analysis modeling. By the new algorithm, neither collecting a great number of samples nor need measuring all spectra of training samples using different instruments are needed. For a set of gasoline samples, SSE can be reduced from 1.418 to 0.167 via the new standardization algorithm and satisfactory results were obtained.
|
Received: 2006-11-18
Accepted: 2007-02-19
|
|
Corresponding Authors:
DAI Lian-kui
E-mail: lkdai@iipc.zju.edu.cn
|
|
[1] SHI Yu-zhen, CHEN Zhi-chun, LIN Xian-fu(施玉珍, 陈志春, 林贤福). Chinese Journal of Analytical Chemistry(分析化学) , 2005, 33(2):272. [2] Bergman E L, Brage H, Josefson M, et al. Journal of Pharmaceutical and Biomedical Analysis, 2006, 41(1): 89. [3] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立, 袁洪福, 陆婉珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2001, 21(6): 881. [4] Wang Y D,Veltkamp D J,Kowalski B R. Analytical Chemistry,1991,63: 1991. [5] Noordm O E. Chemometrics and Intelligent Laboratory Systems, 1994, 25: 85. [6] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立, 袁洪福, 陆婉珍). Chinese Journal of Analytical Chemistry(分析化学), 2002, 30(1):114. [7] WU Zhong-chen, XU Xiao-xuan, YANG Ren-jie, et al(武中臣, 徐晓轩, 杨仁杰, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2005, 25(12): 1975. [8] Park K S, Ko Y H, Lee H, et al. Chemometrics and Intelligent Laboratory Systems, 2001, 55(13):53. [9] Sjoblom J, Svensson O, Josefson M, et al. Chemometrics and Intelligent Laboratory Systems, 1998, 44(14): 229. [10] ZHANG Lin, ZHANG Li-ming, LI Yan, et al(张 琳, 张黎明, 李 燕, 等). Chinese Journal of Analytical Chemistry(分析化学), 2005, 33(12): 1709. [11] Blank T B, Sum S T, Brown S D. Analytical Chemistry,1996,68:2987. [12] Bouveresse E, Massart D L. Chemometrics and Intelligent Laboratory Systems, 1996, 32(2): 201. [13] LU Wan-zhen, YUAN Hong-fu, XU Guang-tong, et al(陆婉珍,袁洪福,徐广通,等). Modern Analytical Techniques in Near-Infrared Spectroscopy(现代近红外光谱分析技术). Beijing:China Petrochemical Press(北京:中国石化出版社),2000. 193. [14] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立,袁洪福,陆婉珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2005,25(6):886. [15] Kelly J J, Barlow C H, Jinguji T M, et al. Analytical Chemistry, 1989, 61: 313. [16] WU Yan-ping, LI Guo-liang, LU Wan-zhen, et al(吴艳萍,李国梁,陆婉珍,等). Petroleum Processing and Petrochemicals(石油炼制与化工),2002,33(5):57. [17] ZHANG Qi-ke, DAI Lian-kui(张其可,戴连奎). Journal of Transduction Technology(传感技术学报),2006,19(4):1190. [18] TIAN Gao-you, YUAN Hong-fu, CHU Xiao-li, et al(田高友,袁洪福,褚小立,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2005,25(4):516.
|
[1] |
LI Jie, ZHOU Qu*, JIA Lu-fen, CUI Xiao-sen. Comparative Study on Detection Methods of Furfural in Transformer Oil Based on IR and Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 125-133. |
[2] |
GAO Feng1, 2, XING Ya-ge3, 4, LUO Hua-ping1, 2, ZHANG Yuan-hua3, 4, GUO Ling3, 4*. Nondestructive Identification of Apricot Varieties Based on Visible/Near Infrared Spectroscopy and Chemometrics Methods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 44-51. |
[3] |
LI Xin-ting, ZHANG Feng, FENG Jie*. Convolutional Neural Network Combined With Improved Spectral
Processing Method for Potato Disease Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 215-224. |
[4] |
BAO Hao1, 2,ZHANG Yan1, 2*. Research on Spectral Feature Band Selection Model Based on Improved Harris Hawk Optimization Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 148-157. |
[5] |
LI Wei1, TAN Feng2*, ZHANG Wei1, GAO Lu-si3, LI Jin-shan4. Application of Improved Random Frog Algorithm in Fast Identification of Soybean Varieties[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3763-3769. |
[6] |
HU Cai-ping1, HE Cheng-yu2, KONG Li-wei3, ZHU You-you3*, WU Bin4, ZHOU Hao-xiang3, SUN Jun2. Identification of Tea Based on Near-Infrared Spectra and Fuzzy Linear Discriminant QR Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3802-3805. |
[7] |
LIU Xin-peng1, SUN Xiang-hong2, QIN Yu-hua1*, ZHANG Min1, GONG Hui-li3. Research on t-SNE Similarity Measurement Method Based on Wasserstein Divergence[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3806-3812. |
[8] |
BAI Xue-bing1, 2, SONG Chang-ze1, ZHANG Qian-wei1, DAI Bin-xiu1, JIN Guo-jie1, 2, LIU Wen-zheng1, TAO Yong-sheng1, 2*. Rapid and Nndestructive Dagnosis Mthod for Posphate Dficiency in “Cabernet Sauvignon” Gape Laves by Vis/NIR Sectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3719-3725. |
[9] |
WANG Qi-biao1, HE Yu-kai1, LUO Yu-shi1, WANG Shu-jun1, XIE Bo2, DENG Chao2*, LIU Yong3, TUO Xian-guo3. Study on Analysis Method of Distiller's Grains Acidity Based on
Convolutional Neural Network and Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3726-3731. |
[10] |
LUO Li, WANG Jing-yi, XU Zhao-jun, NA Bin*. Geographic Origin Discrimination of Wood Using NIR Spectroscopy
Combined With Machine Learning Techniques[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3372-3379. |
[11] |
ZHANG Shu-fang1, LEI Lei2, LEI Shun-xin2, TAN Xue-cai1, LIU Shao-gang1, YAN Jun1*. Traceability of Geographical Origin of Jasmine Based on Near
Infrared Diffuse Reflectance Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3389-3395. |
[12] |
YANG Qun1, 2, LING Qi-han1, WEI Yong1, NING Qiang1, 2, KONG Fa-ming1, ZHOU Yi-fan1, 2, ZHANG Hai-lin1, WANG Jie1, 2*. Non-Destructive Monitoring Model of Functional Nitrogen Content in
Citrus Leaves Based on Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3396-3403. |
[13] |
HUANG Meng-qiang1, KUANG Wen-jian2, 3*, LIU Xiang1, HE Liang4. Quantitative Analysis of Cotton/Polyester/Wool Blended Fiber Content by Near-Infrared Spectroscopy Based on 1D-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3565-3570. |
[14] |
HUANG Zhao-di1, CHEN Zai-liang2, WANG Chen3, TIAN Peng2, ZHANG Hai-liang2, XIE Chao-yong2*, LIU Xue-mei4*. Comparing Different Multivariate Calibration Methods Analyses for Measurement of Soil Properties Using Visible and Short Wave-Near
Infrared Spectroscopy Combined With Machine Learning Algorithms[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3535-3540. |
[15] |
KANG Ming-yue1, 3, WANG Cheng1, SUN Hong-yan3, LI Zuo-lin2, LUO Bin1*. Research on Internal Quality Detection Method of Cherry Tomatoes Based on Improved WOA-LSSVM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3541-3550. |
|
|
|
|