| 光谱学与光谱分析 | 
									
										
		  							 | 
          							
		  									  								 
		  									  							|
		  									  								 
		  									  							 | 
        						 
      						 
      					 | 
  					 
  					
    					 | 
   					 
   										
    					| Outlier Diagnosis and Calibration Model Optimization for Near Infrared Spectroscopy Analysis  | 
  					 
  					  										
						| MIN Shun-geng, LI Ning, ZHANG Ming-xiang | 
					 
															
						| College of Science, China Agricultural University, Beijing 100094, China | 
					 
										
						 | 
					 
				 
				
				
					
						
							
								
									
										
											
                        					 
												
													
													    | 
													    	
														 | 
													 
																										
													
														
															
													
													    | 
													     		                            						                            																	    Abstract  Outlier diagnosis is a very important step in building near infrared calibration model. Data outlier includes spectral outlier and chemical value outlier. Mahalanobis’ distance, ratio of spectral residual and spectral variable leverage test were used to evaluate sample spectral outlier. Cook’s distance and the ratio of sample square error of chemical value and predict value to the mean square error of calibration set were used to test chemical value outlier. Three calibration models of protein content of 50 wheat samples, protein content of 90 corn samples and cyclohexane content of four compounds mixture were investigated. It is demonstrated that outlier test is very helpful for optimizing near infrared calibration model. 
																										     | 
														 
														
														
															| 
											   							Received: 2002-12-26    
						    						    							Accepted: 2003-05-06    
						    						    						    																				    
															 | 
														 
														 														
															| 
																
															 | 
														 
																																									    														
															| 
																Corresponding Authors:
																MIN Shun-geng   
																													     		
													     	 | 
														 
																																												 
															 | 
											
														 
														
													 
													
														
															| Cite this article:    | 
														 
														
															| 
															MIN Shun-geng,LI Ning,ZHANG Ming-xiang. Outlier Diagnosis and Calibration Model Optimization for Near Infrared Spectroscopy Analysis [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2004, 24(10): 1205-1209.	
     																													 | 
														 
														 |  
														
															 | 
														 
														 |  
														
															| URL:   | 
														 
														
															| 
																														http://www.gpxygpfx.com/EN/Y2004/V24/I10/1205 | 
														 
													 
												 
												
												
													
														  
															 [1] LU Wan-zhen, YUAN Hong-fu, XU Guang-tong(陆婉珍,袁洪福,徐广通). The Modern Analysis Technique for Near-infrared Spectra(现代近红外光谱分析技术). Beijing: Chinese Oil and Chemical Press(北京:中国石化出版社),2000. 193. [2] Egan W J, Mogan S L. Analytical Chemistry, 1998, 70(11): 2372. [3] XU Guang-tong, YUAN Hong-fu, LU Wan-zhen(徐广通,袁洪福,陆婉珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析),2001,21(4):459. [4] Edwin M, Knorr A I, Raymond T et al. The International Journal on Very Large Data Bases, 2000, 8: 237. [5] YAN Yan-lu, JING Mao, ZHANG Lu-da(严衍禄,景 茂,张录达). Acta of Beijing Agricultural University(北京农业大学学报·增刊),1990,16:37.
  | 
														 
														
													 
												 
												
													
														
															
																
																																																																																						
																				
																					| [1] | 
																					WANG Xue-pei1, 2, ZHANG Lu-wei1, 2, BAI Xue-bing3, MO Xian-bin1, ZHANG Xiao-shuan1, 2*. Infrared Spectral Characterization of Ultraviolet Ozone Treatment on Substrate Surface for Flexible Electronics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1867-1873. | 
																				 
																			
																																																																																																									
																				
																					| [2] | 
																					SHI Wen-qiang1, XU Xiu-ying1*, ZHANG Wei1, ZHANG Ping2, SUN Hai-tian1, 3, HU Jun1. Prediction Model of Soil Moisture Content in Northern Cold Region Based on Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1704-1710. | 
																				 
																			
																																																																																																									
																				
																					| [3] | 
																					WANG Yue1, 3, 4, CHEN Nan1, 2, 3, 4, WANG Bo-yu1, 5, LIU Tao1, 3, 4*, XIA Yang1, 2, 3, 4*. Fourier Transform Near-Infrared Spectral System Based on Laser-Driven Plasma Light Source[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1666-1673. | 
																				 
																			
																																																																																																									
																				
																					| [4] | 
																					FENG Rui-jie1, CHEN Zheng-guang1, 2*, YI Shu-juan3. Identification of Corn Varieties Based on Bayesian Optimization SVM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1698-1703. | 
																				 
																			
																																																																																																									
																				
																					| [5] | 
																					YU Zhi-rong, HONG Ming-jian*. Near-Infrared Spectral Quantitative Analysis Network Based on Grouped Fully Connection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1735-1740. | 
																				 
																			
																																																																																																									
																				
																					| [6] | 
																					MENG Fan-jia1, LUO Shi1, WU Yue-feng1, SUN Hong1, LIU Fei2, LI Min-zan1*, HUANG Wei3, LI Mu3. Characteristic Extraction Method and Discriminant Model of Ear Rot of Maize Seed Base on NIR Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1716-1720. | 
																				 
																			
																																																																																																									
																				
																					| [7] | 
																					PENG Yan-fang1, WANG Jun1, WU Zhi-sheng2*, LIU Xiao-na3, QIAO Yan-jiang2*. NIR Band Assignment of Tanshinone ⅡA and Cryptotanshinone by 
2D-COS Technology and Model Application Tanshinone Extract[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1781-1785. | 
																				 
																			
																																																																																																									
																				
																					| [8] | 
																					WANG Li-qi1, YAO Jing1, WANG Rui-ying1, CHEN Ying-shu1, LUO Shu-nian2, WANG Wei-ning2, ZHANG Yan-rong1*. Research on Detection of Soybean Meal Quality by NIR Based on 
PLS-GRNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1433-1438. | 
																				 
																			
																																																																																																									
																				
																					| [9] | 
																					FU Yan-hua1, LIU Jing2*, MAO Ya-chun2, CAO Wang2, HUANG Jia-qi2, ZHAO Zhan-guo3. Experimental Study on Quantitative Inversion Model of Heavy Metals in Soda Saline-Alkali Soil Based on RBF Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1595-1600. | 
																				 
																			
																																																																																																									
																				
																					| [10] | 
																					LI Jia-yi1, YU Mei1, LI Mai-quan1,  ZHENG Yu2*, LI Pao1,  3*. Nondestructive Identification of Different Chrysanthemum Varieties Based on Near-Infrared Spectroscopy and Pattern Recognition Methods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1129-1133. | 
																				 
																			
																																																																																																									
																				
																					| [11] | 
																					CHEN Chu-han1, ZHONG Yang-sheng2, WANG Xian-yan3, ZHAO Yi-kun1, DAI Fen1*. Feature Selection Algorithm for Identification of Male and Female 
Cocoons Based on SVM Bootstrapping Re-Weighted Sampling[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1173-1178. | 
																				 
																			
																																																																																																									
																				
																					| [12] | 
																					LI Xue-ying1, 2, LI Zong-min3*, CHEN Guang-yuan4, QIU Hui-min2, HOU Guang-li2, FAN Ping-ping2*. Prediction of Tidal Flat Sediment Moisture Content Based on Wavelet Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1156-1161. | 
																				 
																			
																																																																																																									
																				
																					| [13] | 
																					ZHANG Xiao-hong1,  JIANG Xue-song1*,  SHEN Fei2*,  JIANG Hong-zhe1,  ZHOU Hong-ping1,  HE Xue-ming2,  JIANG Dian-cheng1, ZHANG Yi3. Design of Portable Flour Quality Safety Detector Based on Diffuse 
Transmission Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1235-1242. | 
																				 
																			
																																																																																																									
																				
																					| [14] | 
																					WANG Sheng-ming1,  WANG Tao1*,  TANG Sheng-jin2,  SU Yan-zhao1. Hyperspectral Anomaly Detection Based on 3D Convolutional 
Autoencoder Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1270-1277. | 
																				 
																			
																																																																																																									
																				
																					| [15] | 
																					ZHENG Kai-yi1, ZHANG Wen1, DING Fu-yuan1, ZHOU Chen-guang1, SHI Ji-yong1, Yoshinori Marunaka2, ZOU Xiao-bo1*. Using Ensemble Refinement (ER) Method to OptimizeTransfer Set of Near-Infrared Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(04): 1323-1328. | 
																				 
																			
																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																																														 
														 | 
													 
												 
											 
											
											 
											
											 
										 
									 | 
								 
							 
						 | 
					 
				 
			
		 |