中红外光谱双重校验异常样本检测方法研究

doi:10.3964/j.issn.1000-0593(2024)06-1546-07

Abstract
References
Related Citation (15)

Download: PDF (4660 KB)
Export: BibTeX | EndNote (RIS)

Abstract Mid-infrared absorption spectroscopy is one of the most promising non-invasive blood glucose measurement techniques. The accuracy of blood glucose concentration measurement results of the mid-infrared absorption spectrum is closely related to the reliability of spectral signals. However, collecting mid-infrared spectral signals is susceptible to environmental or human factors, and an anomaly spectrum containing a large amount of interference information will be generated. The existence of an anomaly spectrum will reduce the effectiveness and reliability of the prediction model, so the detection and removal of abnormal samples are crucial. This study proposes that the twin check abnormal sample detection method can accurately screen and eliminate abnormal samples. This algorithm is divided into two stages. Firstly, the Monte Carlo cross-validation abnormal sample detection method is used to preliminarily screen abnormal samples and improve the stability of the spectral sample set. Secondly, based on the theory that Mahalanobis distance square approximately obeys chi-square distribution, the optimal threshold is adaptively determined, and the remaining data sets are re-identified with abnormal samples. 64 samples of the glucose-mixed imitated solution containing glucose, albumin, urea, lactic acid, fructose and cholesterol were studied. The twin check method first uses the characteristic that the sum of squared prediction errors is sensitive to abnormal samples to make a preliminary judgment on the abnormal samples in the spectral data set, and a total of 3 abnormal samples are detected. The PLS correction model is established after removing the abnormal samples from the spectral data set. The correlation coefficient of this model is 0.91, and RMSECV is 60.17 mg·dL^-1. Secondly, the twin check method is based on the theory of Mahalanobis distance square approximately conforming to chi-square distribution, which realizes the adaptive identification of abnormal samples. A total of 12 abnormal samples were detected. The performance of the PLS model constructed after removing all abnormal samples was improved, with the correlation coefficient reaching 0.99 and RMSECV reaching 57.77 mg·dL^-1. By comparing the results of the twin check method with the non-abnormal sample removal, PCA-MD method and Monte Carlo method, the superiority of this algorithm in abnormal sample detection is proved. Compared with the PLS model without removing abnormal samples, the correlation coefficient increased from 0.86 to 0.99, and RMSECV decreased from 67.51 to 57.77 mg·dL^-1, increasing by 15.12% and 14.42%, respectively. This study provides a good solution strategy for the problem of false detection of normal samples or missing detection of abnormal samples due to the easy influence of threshold of existing abnormal sample detection methods, which is conducive to the method's accurate detection and elimination of abnormal samples, thus improving the accuracy and prediction performance of the prediction model. This method provides a way to eliminate the abnormal samples of mid-infrared absorption spectrum accurately.

Key words：Infrared spectroscopy; Abnormal sample; Twin check; Adaptive threshold

Received: 2023-05-31 Accepted: 2023-09-25

ZTFLH:

O433.1

Corresponding Authors: XIE Qin-lan, ZHANG Xian-wen E-mail: xieqinlan@126.com；zxwen84@163.com

Cite this article:

ZHANGZHU Shan-ying,ZHANG Ruo-jing,GU Han-wen, et al. Research on the Twin Check Abnormal Sample Detection Method of Mid-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(06): 1546-1552.

URL:

https://www.gpxygpfx.com/EN/10.3964/j.issn.1000-0593(2024)06-1546-07 OR https://www.gpxygpfx.com/EN/Y2024/V44/I06/1546

[1] Marjan Gusev, Lidija Poposka, Gjoko Spasevski, et al. Journal of Sensors, 2020, 2020: 9628281.
[2] Mekonnen B K, Yang W, Hsieh T H, et al. Biomedical Signal Processing and Control, 2020, 59: 101923
[3] Baba A M, Midi H, Adam M B, et al. Symmetry，2021, 13(11): 2030.
[4] ZHAO Zhi-lei, WANG Xue-mei, LIU Dong-dong, et al(赵志磊，王雪妹，刘冬冬，等). Spectroscopy and Spectral Analysis(光谱学与光谱分析)，2022，42(9)：2836.
[5] LIAO Wen-hui, HUANG Ying-qiang, HE Zhi-feng, et al(廖文辉, 黄颖强, 何志锋, 等). Journal of Applied Statistics and Management(数理统计与管理), 2021, 40(5): 822.
[6] CHEN Bo-wen, ZHUAN Sun-hao, JIN Yong-qi, et al(陈博文, 颛孙浩, 金咏琪, 等). Journal of Forest and Environment(森林与环境学报), 2022, 42(1): 88.
[7] GUO Liang, LIU Jian-ya, LU Ruo-dan. Science China Mathematics, 2021, 64(1): 197.
[8] ZHOU Yang, WANG Chun-lin, GUO Rui（周杨, 王春林, 郭锐）. Modern Electronic Technology（现代电子技术）, 2023, 46(8): 143.
[9] JIANG Ming-wei, WANG Cai-hong, ZHANG Qing-hui(姜明伟, 王彩红, 张庆辉). Journal of Henan University of Technology(Natural Science Edition[河南工业大学学报(自然科学版)], 2020, 41(6): 91.
[10] YUAN Ying, WANG Xue-feng(袁莹, 王雪峰). Scientia Silvae Sinicae(林业科学), 2022, 58(9): 36.
[11] Ine L Jernelv, Karina Strom, Dag Roar Hjelme, et al. Sensors, 2019, 19(23): 5130.
[12] Fuglerud S S, Ellingsen R, AksnesA, et al. Journal of Biophotonics, 2021, 14(5): e202000450.
[13] CHEN Ting, LIU Qing-jun, WU Yan-wen, et al(陈婷，刘清珺，武彦文，等). Journal of Food Safety & Quality(食品安全质量检测学报), 2015, 6(3): 836.
[14] SHI Lu-zhen, CHEN Jie, ZHANG Shu-yan, et al(石鲁珍, 陈杰, 张树艳, 等). Jiangsu Agricultural Sciences(江苏农业科学), 2018, 46(14): 205.
[15] Etherington Thomas R. Peer J, 2019, 7: e6678.