光谱学与光谱分析 |
|
|
|
|
|
Multi-Population Elitists Shared Genetic Algorithm for Outlier Detection of Spectroscopy Analysis |
CAO Hui1,ZHOU Yan2* |
1. School of Electrical Engineering, Xi’an Jiaotong University, Xi’an 710049, China 2. School of Energy and Power Engineering, Xi’an Jiaotong University, Xi’an 710049, China |
|
|
Abstract The present paper proposed an outlier detection method for spectral analysis based on multi-population elitists shared genetic algorithm. The method was exploited in the NIR data set analysis to remove the outliers from the data set, and partial least squares (PLS) was combined with the proposed method to build a prediction model. In contrast with Monte Carlo cross validation, leave-one-out cross validation, Mahalanobis-distance and traditional genetic algorithm for outlier detection, the prediction residual error sum of squares (PRESS) for moisture prediction model based on the proposed method decreases in the rate of 72.4%, 39.5%, 39.5% and 14.5%; the PRESS value for fat prediction model decreases in the rate of 86.2%, 75.9%, 84.9% and 19.9%; and the PRESS value for protein prediction model decreases in the rate of 56.5%, 35.7%, 35.7% and 18.2% respectively. Results indicated that the method is applicable for spectral outlier detection for different species, and the model based on the data set without the removed outliers is more accurate and robust.
|
Received: 2011-01-03
Accepted: 2011-04-20
|
|
Corresponding Authors:
ZHOU Yan
E-mail: yan.zhou@mail.xjtu.edu.cn
|
|
[1] Lü Jian-feng, DAI Lian-kui(吕剑峰, 戴连奎). Chinese J. Anal. Chem.(分析化学), 2007, 35(3): 340. [2] Gozde Gurdeniza, Banu Ozen. Food Chemistry, 2009, 116(2): 519. [3] Zoua Hongyan, Wu Hailong, Fua Haiyan, et al. Talanta, 2010, 80(5): 1698. [4] Chen Da, Cai Wensheng, Shao Xueguang. Vibrational Spectroscopy, 2008, 47(2): 113. [5] Zhang Jifu, Jiang Yiyong, Chang Kai H, et al. Pattern Recognition Letters, 2009, 30(15): 1434. [6] BAO Xin, DAI Lian-kui(包 鑫, 戴连奎). Acta Chimica Sinica(化学学报), 2009, 67(10): 1081. [7] Patrick Wiegand, Randy Pell, Enric Comas. Chemometrics and Intelligent Laboratory Systems, 2009, 98(3): 108. [8] Xin Bao, Liankui Dai. Fuel, 2009, 88(7): 1216. [9] DAN Tu-nan, DAI Lian-kui(淡图南, 戴连奎). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2010, 30(4): 979. [10] Liu Zhichao, Cai Wensheng, Shao Xueguang. Science in China, Series B-Chemistry, 2008, 51(8): 751. [11] Bian Xihui, Cai Wensheng, Shao Xueguang, et al. Analyst, 2010, 135(11): 2841. [12] Li Yongming, Zhang Sujuan, Zeng Xiaoping. Expert Systems with Applications, 2009, 36(9): 11570. [13] Borggard C, Thodberg H. Anal. Chem., 1992, 64(5): 545.
|
[1] |
GAO Wei-ling, ZHANG Kai-hua*, XU Yan-fen, LIU Yu-fang*. Data Processing Method for Multi-Spectral Radiometric Thermometry Based on the Improved HPSOGA[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3659-3665. |
[2] |
NIU Fang-peng1, 2, LI Xin-guo1, 3*, BAI Yun-gang2, ZHAO Hui4. Hyperspectral Estimation Model of Soil Organic Carbon Content Based on Genetic Algorithm Fused With Continuous Projection Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2232-2237. |
[3] |
ZHENG Kai-yi, SHEN Ye, ZHANG Wen, ZHOU Chen-guang, DING Fu-yuan, ZHANG Yang, ZHANG Rou-jia, SHI Ji-yong, ZOU Xiao-bo*. Interval Genetic Algorithm for Double Spectra and Its Applications in Calibration Transfer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3783-3788. |
[4] |
LIU Meng-xuan1, 2, 3, 4, WU Qiong5, WANG Xu-quan1, 2, 4, CHEN Qi5, ZHANG Yong-gang1, 2, HUANG Song-lei1, 2*, FANG Jia-xiong1, 2*. Validity and Redundancy of Spectral Data in the Detection Algorithm of Sucrose-Doped Content in Tea[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3647-3652. |
[5] |
GUO Yang1, GUO Jun-xian1*, SHI Yong1, LI Xue-lian1, HUANG Hua2, LIU Yan-cen1. Estimation of Leaf Moisture Content in Cantaloupe Canopy Based on
SiPLS-CARS and GA-ELM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(08): 2565-2571. |
[6] |
HUANG Qing1, XUE He-ru1*, LIU Jiang-ping1*, LIU Mei-chen1, HU Peng-wei1, SUN De-gang2. Spectral Selection Method Based on Ant Colony-Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2262-2268. |
[7] |
JIANG Qing-hu1, LIU Feng1, YU Dong-yue2, 3, LUO Hui2, 3, LIANG Qiong3*, ZHANG Yan-jun3*. Rapid Measurement of the Pharmacological Active Constituents in Herba Epimedii Using Hyperspectral Analysis Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1445-1450. |
[8] |
WANG Xue-yuan1, 2, 3, HE Jian-feng1, 2, 3*, NIE Feng-jun2, YUAN Zhao-lin1, 2, 3, LIU Lin1, 2, 3. Decomposition of X-Ray Fluorescence Overlapping Peaks Based on Quantum Genetic Algorithm With Multi-Fitness Function[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 152-157. |
[9] |
LIU Chen-yang1,2, XU Huang-rong2,3, DUAN Feng4, WANG Tai-sheng1, LU Zhen-wu1, YU Wei-xing3*. Spectral Discrimination of Rabbit Liver VX2 Tumor and Normal Tissue Based on Genetic Algorithm-Support Vector Machine[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(10): 3123-3128. |
[10] |
LI Hao-guang1, 2, YU Yun-hua1, 2, PANG Yan1 , SHEN Xue-feng1, 2. Study on Characteristic Wavelength Extraction Method for Near Infrared Spectroscopy Identification Based on Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(08): 2437-2442. |
[11] |
WANG Xiao-yan1, LI Jie2*, PENG Bang-ping1, TU Yi-cheng3. Restoration of High-Frequency Vibration Blurred Hyperspectral Image Based on Dynamic Chaos Disturbance Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2219-2225. |
[12] |
LING Liu-yi1,3*, HUANG You-rui1,2*, WANG Chen-jun1, HU Ren-zhi3, LI Ang3, XIE Pin-hua3. Optimization of IBBCEAS Spectral Retrieval Range Based on Machine Learning and Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1869-1873. |
[13] |
WU Ting1, 2, 3, LIANG Long1, 3, ZHU Hua3, DENG Yong-jun1, 3, FANG Gui-gan1, 3*. Near-Infrared Analysis and Models Optimization of Main Components in Pulpwood of Hainan Province[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(05): 1404-1409. |
[14] |
QI Wei, FENG Peng*, WEI Biao, ZHENG Dong, YU Ting-ting, LIU Peng-yong. Feature Wavelength Optimization Algorithm for Water Quality COD Detection Based on Embedded Particle Swarm Optimization-Genetic Algorithm[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 194-200. |
[15] |
MAO Ya-chun1,2, DING Rui-bo1*, LIU Shan-jun1,2, BAO Ni-sha1,2. Research on Inversion Model of Low-Grade Porphyry Copper Deposit Based on Visible-Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(08): 2474-2478. |
|
|
|
|