光谱学与光谱分析
|
近红外漫反射光谱中散射对化学定量分析模型的影响
刘莉,黄岚,严衍禄,王忠义*
中国农业大学信息与电气工程学院,北京 100083
Progress in the Study of Impact of Scattering on Stability of Quantitative Analysis Model Using Near Infrared Spectroscopy Technology and Correction Methods
LIU Li,HUANG Lan,YAN Yan-lu,WANG Zhong-yi*
College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
摘要 : 结合国内外研究发展现状,分析了近红外光谱分析与检测技术中影响模型稳健性及预测模型精度的原因,特别是散射的影响。阐述了近红外光与样品组织之间的相互作用机理,及近红外光谱法定量分析模型中散射对漫反射光的影响,总结了光学方法中光学特性参数(散射系数、吸收系数)的主要检测技术的研究进展。探讨了近红外光谱检测与分析技术为基础的定量模型中为改善、增强模型稳健性所用的方法及效果,如中心化、附加散射校正(MSC)等预处理算法;偏最小二乘法(PLS)、主成分回归方法(PCA)等不同的多元校正方法。采用现有的数据预处理方法,可以改善散射对模型的稳健性的影响,但要在浓度范围较大、样品物理状态复杂的情况下消除散射引起的模型预测误差仍需要探索新的方法。
关键词 :近红外;光学参数;散射校正;蒙特卡罗;模型稳健性
Abstract :Near infrared spectroscopy technology for inner quality detection and analysis is a rapid and accurate technique. The factors affecting the stability of quantitative analysis models based on NIRS especially the influence of scattering, were investigated. The methods of determination of the parameters of optical properties of sample (scattering coefficient and absorption coefficient) and the interaction between light and sample were summarized. The progress in pretreatment methods to improve the model’s stability, such as transformation of standard normal variate (SNV) and multiplication scatter correction (MSC); as well as the multivariate calibration model techniques, such as partial least square (PLS) and primary component analysis regression(PCA), were also described. The model with scatter correction pretreatments and different regression methods were compared to establish a better regression equation by near Infrared reflectance spectroscopy (NIRS). Although pretreatment methods could improve the robustness of model for influence of scattering, new techniques should be employed to eliminate the error of predication under scattering condition when samples are complicated in physical states and are in the large range of concentration.
Key words :NIR;Optical parameters;Scatter correction;Monte carlo;Model stability
收稿日期: 2008-01-08
修订日期: 2008-03-18
通讯作者:
王忠义
E-mail: wzyhl@cau.edu.cn
引用本文:
刘莉,黄岚,严衍禄,王忠义* . 近红外漫反射光谱中散射对化学定量分析模型的影响[J]. 光谱学与光谱分析, 2008, 28(10): 2290-2295.
LIU Li,HUANG Lan,YAN Yan-lu,WANG Zhong-yi* . Progress in the Study of Impact of Scattering on Stability of Quantitative Analysis Model Using Near Infrared Spectroscopy Technology and Correction Methods. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2008, 28(10): 2290-2295.
链接本文:
https://www.gpxygpfx.com/CN/10.3964/j.issn.1000-0593(2008)10-2290-06
或
https://www.gpxygpfx.com/CN/Y2008/V28/I10/2290
[1] HUANG Lan, TIAN Feng-hua, DING Hai-shu, et al(黄 岚, 田丰华, 丁海曙, 等). J. Infrared Millim. Waves(红外与毫米波学报),2003,22(5): 379. [2] Brown S D. Anal. Chem., 1990, 62: 84R. [3] LU Wan-zhen, YUAN Hong-fu, XU Guang-tong, et al(陆婉珍, 袁洪福, 徐广通,等). Modern Near Infrared Spectroscopy Analysis Technology(现代近红外光谱分析技术). Beijing: China Petrochemical Press(北京: 中国石化出版社),2000. [4] YUAN Hong-fu, LU Wan-zhen(袁洪福, 陆婉珍). Petroleum Processing and Petprochemicals(石油炼制与化工), 1998,29(9): 47. [5] LI Jun-hui, ZHAO Long-lian, LAO Cai-lian, et al(李军会, 赵龙莲, 劳彩莲, 等). Modern Scientific Instrument(现代科学仪器),2005, (1): 17. [6] XU Guang-tong, YUAN Hong-fu, LU Wan-zhen(徐广通, 袁洪福, 陆婉珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2000,20(2): 134. [7] WANG Wen-zhen(王文真). Modern Scientific Instrument(现代科学仪器), 1996, (1): 24. [8] ZHOU Ying, FU Xia-ping, YING Yi-bin(周 莹, 傅霞萍, 应义斌). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(11): 2197. [9] LI Jun-hui, QIN Xi-yun, ZHANG Wen-juan, et al(李军会, 秦西云, 张文娟, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(9): 1751. [10] Bogrekci Ismail, Lee Wonsuk. ASAE Annual International Meeting,2004. 4347. [11] ZHAO Li-li, ZHAO Long-lian, LI Jun-hui, et al(赵丽丽, 赵龙莲, 李军会, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2004,24(1): 41. [12] XIE Li-juan, LIU Dong-hong, ZHANG Yu-huan, et al(谢丽娟, 刘东红, 张宇环, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(8): 1489. [13] YAN Yan-lu, ZHAO Long-lian, HAN Dong-hai(严衍禄, 赵龙莲, 韩东海, 等). The Application and the Foundation of Near Infrared Spectroscopy Analysis(近红外光谱分析基础与应用). Beijing: China Light Industry Press(中国轻工业出版社),2005. 98,109,98,13,15,133. [14] CHU Xiao-li, YUAN Hong-fu, LU Wan-zhen(褚小立, 袁洪福, 陆婉珍). Progress in Chemistry(化学进展),2004, 16(4): 528. [15] GAO Rong-qiang, FAN Shi-fu, YAN Yan-lu, et al(高荣强, 范世福, 严衍禄, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2004,24(12): 1563. [16] CUI Hou-xin, XU Ke-xin, CHEN Min-sen, et al(崔厚欣, 徐可欣, 陈民森, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2006,26(5): 838. [17] Isaksson, Tomas, Naes Tormod. Applied Spectroscopy, 1988, 42(7): 1273. [18] ZHAO Qiang, ZHANG Gong-li, CHEN Xing-dan(赵 强, 张工力, 陈星旦). Optics and Precision Engineering(光学精密工程),2005, 13(1):53. [19] XIONG Zhi-xin, WU Zhong-chen, CHEN Zhao-xia, et al(熊智新, 武中臣, 陈朝霞, 等). Chinese Journal of Spectroscopy Laboratory(光谱实验室),2007,24(5): 953. [20] WU Jian-guo, SHI Chun-hai, ZHANG Hai-zhen, et al(吴建国, 石春海, 张海珍, 等). Crop Journal(作物学报),2002,28(3): 421. [21] WU Jian-guo, SHI Chun-hai, ZHANG Xiao-ming, et al(吴建国, 石春海, 张小明, 等). Crop Journal(作物学报),2003,29(5): 688. [22] WANG Wei-dong, GU Yun-hong, QIN Guang-yong, et al(王卫东, 谷运红, 秦广雍, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(4): 697. [23] WU Jing-zhu, WANG Yi-ming, ZHANG Xiao-chao, et al(吴静珠, 王一鸣, 张小超, 等). Modern Scientific Instrument(现代科学仪器),2006, (1): 69. [24] ZHAO Li-li, ZHANG Lu-da, SONG Zhong-xiang, et al(赵丽丽, 张录达, 宋忠祥, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(1): 46. [25] Watari Masahiro, Du Yiping, Ozaki Yukihiro. Applied Spectroscopy,2007, 61(4): 397. [26] MA Guang, FU Xia-ping, ZHOU Ying, et al(马 广, 傅霞萍, 周 莹, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(5): 907. [27] WU Di, FENG Lei, ZHANG Chuan-qing, et al(吴 迪, 冯 雷, 张传清, 等). J. Infrared Millim. Waves(红外与毫米波学报),2007,26(4): 269. [28] DOU Ying, MI Hong, ZHAO Lingzhi, et al. Spectrochimica Acta, Part A: Molecular and Biomolecular Spectroscopy,2006, 65(1): 79. [29] WANG Li-jie, GUO Jian-ying, XU Ke-xin(王丽杰, 郭建英, 徐可欣). Journal of Harbin University, Science and Technology(哈尔滨理工大学学报),2004, 9(5): 36. [30] L Li-na, ZHANG Yue, ZHOU Ding-wen(吕丽娜, 张 玥, 周定文). Journal of Tianjin University(天津大学学报),2004, 37(12): 1093. [31] ZHANG Yue, L Li-na, XU Ke-xin(张 玥, 吕丽娜, 徐可新). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2005,25(4): 512. [32] ZENG Li-bo, HE Zhi-ping(曾立波, 贺志平). Analytical Instruments(分析仪器),2006,(3): 23. [33] ZOU Xiao-bo, ZHU Zeng, ZHAO Jie-wen(邹小波, 朱 曾, 赵杰文). Modern Scientific Instruments(现代科学仪器),2007, (1): 86. [34] CHANG Min, CHU Peng-jiao, XU Ke-xin(常 敏, 褚鹏蛟, 徐可欣). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(1): 43. [35] LU Yong-jun, QU Yan-ling, FENG Zhi-qing, et al(芦永军, 曲艳玲, 冯志庆, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007, 127(1): 58. [36] HAN Dong-hai, LU Chao, LIU Yi, PI Fu-wei(韩东海, 鲁 超, 刘 毅, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2007,27(3): 465. [37] YING Yibin, LU Huishan, FU Xiaping, et al. Proceedings of SPIE-The Society of Photo-Optical International Engineering,2005, 5996:599961B. [38] CHEONG W F, Prahl S A, Welch A J. IEEE Journal of Quantum Electronics, 1990,26(12): 2166. [39] ZHAO You-quan, FAN Shi-fu, CAO Wen-xin(赵友全, 范世福, 曹文新). Biomedical Engineering, Foreign Medical Sciences(国外医学生物学工程分册),2000,23(2): 76. [40] WANG Zhong-yi, HOU Rui-feng, HUANG Lan, et al(王忠义, 侯瑞锋, 黄 岚, 等). Transactions of the Chinese Society of Agricultural Engineering(CSAE)(农业工程学报),2007,23(5): 1. [41] Contini Daniele, Martelli Fabrizio, Zaccanti G. Applied Optics, 1997, 36(19): 4587. [42] Haskell Richard C. J. Opt. Soc. Am. A, 1994, 11(10): 2727. [43] Farrell T J, Patterson M S, Wilson B. Med. Phys., 1992, 19(4): 879. [44] Jacques S L. IEEE Transactions on Biomedical Engineering, 1989, 36(12): 1155. [45] Hielscher A H, Jancques S L, Wang Lihong. Phys. Med. Biol., 1995, 40: 1957. [46] Kienle A, Patterson M S. J. Opt. Sos. Am. A, 1997, 14(1): 246. [47] ZHANG Lian-shun, ZHANG Chun-ping, XUE Ling-ling, et al(张连顺, 张春平, 薛玲玲, 等). Acta Scientiarum Naturalium Universitatis Nankaiensis(南开大学学报),2001, 34(1): 92. [48] ZHANG Lian-shun(张连顺). Journal of Dezhou University(德州学院学报),2001, 17(4): 16. [49] ZHANG Lin, ZHANG Lian-shun, XU Tang, et al(张 琳, 张连顺, 许 棠, 等). Acta Photonica Sinica(光子学报),2004, 33(11): 1377. [50] ZHANG Lian-shun, ZHANG Chun-ping, WANG Xin-yu, et al(张连顺, 张春平, 王新宇, 等). Chinese Journal of Quantum Electronics(量子电子学报),2002, 19(4): 318. [51] ZHANG Lian-shun, ZHANG Chun-ping, WANG Xin-yu, et al(张连顺, 张春平,王新宇, 等). Journal of Optoelectronics·Laser(光电子·激光),2004, 15(6): 746 [52] Liu Hanli, David A Boast, Yutao Zhang, et al. Phys. Med. Biol., 1995, 40: 1983. [53] Yavari N, Dam J S, Antonsson J, et al. Med. Biol. Eng. Comput.,2005, 43: 658. [54] Dam J S, Yavari N, Sorensen S, et al. Applied Optics,2005, 44(20): 4281. [55] Rinaldo Cubeddu, Cosimo D’Andrea, et al. Applied Optics,2001, 40(4): 538. [56] Pickering J W, Prahl S A, Wieringen N V, et al. Applied Optics, 1993, 32(4): 399. [57] Pickering J W, Moes C J M, Sterenborg H J C M, et al. J. Opt. Soc. Am. A, 1992, 9(4): 621. [58] Firbank M,Hiraoka M,Essenpreis M,et al. Phys. Med. Biol., 1993, 38: 503. [59] Salomatina Elena Jiang, Brian Novak, et al. Journal of Biomedical Optics,2006, 11(6): 064026. [60] Sardar D K, Swanland Guang-Yin, Yow R M, et al. Lasers Med. Sci.,2007,22: 46. [61] Kienle Alwin, Wetze Corinna, Bassi Andrea, et al. Journal of Biomedical Optics,2007, 12(1): 014026. [62] GUAN Tang-bing, ZHAO Hui-juan, WANG Zhao-xia,et al. Progress in Biomedical Optics and Imaging,2007, 6436: 643611. [63] MA Zheng, QIN Dongli, GAO Feng. Progress in Biomedical Optics and Imaging,2007, 6534. [64] Bashkatov A N, Genina E A, Kochubey V I, et al. Optics and Spectroscopy,2005, 99(5): 836. [65] Kim Arnold D, Hayakawa Carole, Venugopalan Vasan. Optics Letters,2006, 31(8): 1088. [66] Nishimura, Goro Kida, Tamura Mamoru. Phys. Med. Biol.,2006, 51(11): 2997. [67] WEI Hua-jiang, XING Da, WU Guo-yong, et al(魏华江, 邢 达, 巫国勇, 等). Chinese Journal of Lasers(中国激光),2007, 34(4): 582. [68] XU Tang, ZHANG Chun-ping, WANG Xin-yu, et al(许 棠, 张春平, 王新宇, 等). Journal of Optoelectronics·Laser(光电子·激光),2004, 15(1): 108. [69] WEI Huajiang, XING Da, WU Guoyong, et al. Progceeding of SPIE,2006, 6047: 60471X. [70] XU Zhi-long, WANG Zhong-yi, HUANG Lan, et al(徐志龙, 王忠义, 黄 岚, 等). Transactions of the Chinese Society of Agricultural Engineering(CSAE)(农业工程学报),2006,22(11): 244. [71] HOU Rui-feng, HUANG Lan, WANG Zhong-yi, et al(侯瑞锋, 黄 岚, 王忠义, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2006,26(12): 2193. [72] JI Rui-qin, WANG Zhong-yi, HUANG Lan, et al(姬瑞勤, 王忠义, 黄 岚, 等). Modern Scientific Instrument(现代科学仪器),2006,(1): 119.
[1]
高 峰, 邢雅阁, 罗华平, 张远华, 郭 玲. 基于可见/近红外光谱与化学计量学的杏品种无损鉴别方法 [J]. 光谱学与光谱分析, 2024, 44(01): 44-51.
[2]
刘 佳,郑亚龙,王成博,尹作为,潘少逵. 新疆和田硬水铝石-蓝宝石谱学研究 [J]. 光谱学与光谱分析, 2024, 44(01): 176-180.
[3]
鲍 浩,张 艳. 基于改进哈里斯鹰优化算法的光谱特征波段选择模型研究 [J]. 光谱学与光谱分析, 2024, 44(01): 148-157.
[4]
何庆元,任 义,刘京华,刘 丽,杨 豪,李正鹏,詹秋文. 基于NIRS快速测定苜蓿青干草品质成分 [J]. 光谱学与光谱分析, 2023, 43(12): 3753-3757.
[5]
胡彩平,何成遇,孔丽微,朱优优,武 斌,周浩祥,孙 俊. 模糊线性判别QR分析的茶叶近红外光谱鉴别分析 [J]. 光谱学与光谱分析, 2023, 43(12): 3802-3805.
[6]
刘鑫鹏,孙祥洪,秦玉华,张 敏,宫会丽. 基于Wasserstein散度的t-SNE相似性度量方法研究 [J]. 光谱学与光谱分析, 2023, 43(12): 3806-3812.
[7]
白雪冰,宋昌泽,张倩玮,代斌秀,靳国杰,刘文政,陶永胜. “赤霞珠”葡萄叶片缺磷胁迫的VIS/NIR光谱快速无损诊断方法 [J]. 光谱学与光谱分析, 2023, 43(12): 3719-3725.
[8]
王琦标,何余锴,罗雨诗,王淑君,谢 波,邓 超,刘 勇,庹先国. 基于卷积神经网络和近红外光谱的酒醅酸度分析方法研究 [J]. 光谱学与光谱分析, 2023, 43(12): 3726-3731.
[9]
骆 立,王静仪,徐兆军,那 斌. 基于近红外光谱技术建立木材产地鉴别模型 [J]. 光谱学与光谱分析, 2023, 43(11): 3372-3379.
[10]
张淑芳,雷 蕾,雷顺新,谭学才,刘绍刚,严 军. 近红外漫反射光谱的茉莉花产地溯源 [J]. 光谱学与光谱分析, 2023, 43(11): 3389-3395.
[11]
杨 群,凌琪涵,魏 勇,宁 强,孔发明,周艺凡,张海琳,王 洁. 基于可见-近红外光谱的柑橘叶片功能性氮含量无损监测模型研究 [J]. 光谱学与光谱分析, 2023, 43(11): 3396-3403.
[12]
黄孟强,匡文剑,刘 向,何 良. 基于1D-CNN的近红外光谱定量分析棉/涤纶/羊毛混纺纤维含量方法研究 [J]. 光谱学与光谱分析, 2023, 43(11): 3565-3570.
[13]
黄招娣,陈再良,王 琛,田 彭,章海亮,谢潮勇,刘雪梅. 比较用可见/短波近红外光谱结合机器学习算法测量土壤性质的不同多元校准方法分析 [J]. 光谱学与光谱分析, 2023, 43(11): 3535-3540.
[14]
康明月,王 成,孙鸿雁,李作麟,罗 斌. 基于改进的WOA-LSSVM樱桃番茄内部品质检测方法研究 [J]. 光谱学与光谱分析, 2023, 43(11): 3541-3550.
[15]
黄 华,刘 亚,库尔班古丽·都力昆,曾繁琳,玛依热·麦麦提,阿瓦古丽·麦麦提,买地努尔汗·艾则孜,郭俊先. 融合分数阶微分与PIMP-RF算法的集成学习模型预测成熟期苹果可溶性固形物含量 [J]. 光谱学与光谱分析, 2023, 43(10): 3059-3066.