|
|
|
|
|
|
Research of Parameter Optimization of Preprocessing and Feature Extraction for NIRS Qualitative Analysis Based on PSO Method |
LI Hao-guang1, 2, YU Yun-hua1, 2, PANG Yan1, SHEN Xue-feng1, 2 |
1. College of Mechanical and Control Engineering, Shandong Institute of Petrochemical and Chemical Technology,Dongying 257061,China
2. New Energy College,China University of Petroleum(East China),Dongying 257061,China |
|
|
Abstract In the qualitative analysis of near-infrared spectroscopy, preprocessing and feature extraction are indispensable to achieve good recognition results. Preprocessing is mainly to eliminate the influence of various interference factors on the spectral data. The common preprocessing methods include smoothing, first-order derivatives, normalization, etc., while the feature extraction methods can eliminate the irrelevant information in the data and retain the effective information. The common feature extraction methods include partial least squares, principal component analysis, linear discriminant analysis, etc. Different preprocessing and feature extraction methods have different characteristics. When building a qualitative analysis model, it is often difficult to achieve ideal results by using a single preprocessing or feature extraction method. It is often necessary to use a combination of multiple preprocessing and feature extraction methods to improve the model’s performance. Variable parameters such as feature extraction dimension need to be set in each preprocessing and feature extraction process. These variable parameters have an important impact on the performance of the model. Therefore, multiple parameters need to be determined in multiple preprocessing and multiple feature extraction methods. In practice, the trial and error method is often used to find the optimal value of each parameter. In order to get the optimal value of one of the parameters, it is necessary to fix the other parameter values according to experience. Then a parameter to be optimized is substituted into the NIR qualitative analysis model for trial and error to get the corresponding parameter value of the optimal recognition rate of the model, and take it as the optimal value. After several parameters to be optimized are obtained one by one by trial and error method, the combination of parameters is set into the qualitative analysis model, and finally, qualitative identification is carried out. However, the combination of parameters obtained by the trial and error method is difficult to guarantee the optimal optimal solution. In addition to the trial and error method, the multiple loops nesting method can also be used to obtain the optimal combination of parameters in the preprocessing and feature extraction of the near qualitative analysis model. However, this method consumes a lot of computer memory and computing time and has the disadvantage of low efficiency. In this paper, a method based on particle swarm optimization (PSO) is proposed to optimize the parameters of pre-processing and feature extraction of the NIR qualitative analysis model, which can quickly obtain the optimal parameter combination of pre-processing and feature extraction and ensure that the qualitative analysis model with the optimal parameter combination has the best recognition performance. The experimental results show that the method is effective.
|
Received: 2021-01-20
Accepted: 2021-04-06
|
|
|
[1] Chu X L, Shi Y Y, Chen B, et al. Journal of Instrumental Analysis,2019, 38(5): 603.
[2] YAN Yan-lu, CHEN Bin, ZHU Da-zhou(严衍禄, 陈 斌,朱大洲). Near Infrared Spectroscopy Analytical—Principles, Technology and Application(近红外光谱分析的原理、技术与应用). Beijing: China Light Industry Press(北京: 中国轻工业出版社), 2007.
[3] Mendes T O, Junqueira G M A, Porto B L S,et al. Journal of Raman Spectroscopy, 2016, 47(6):692.
[4] Konstantinos E Parsopoulos, Michael N Vrahatis. Particle Swarm Optimization and Intelligence. 1st ed. Hershey, New York: Information Science Reference, 2010.
[5] Qin H, Ma J Y, Chen S J, et al. Infrared Technology,2015, 1(37): 78.
[6] LI Hao-guang, LI Wei-jun, QIN Hong, et al(李浩光,李卫军,覃 鸿,等). Transactions of the Chinese Society of Agricultural Machinery(农业机械学报),2016, 47(6): 259.
[7] LI Hao-guang, LI Wei-jun, QIN Hong, et al(李浩光,李卫军,覃 鸿,等). Transactions of the Chinese Society of Agricultural Machinery(农业机械学报), 2017,(S1): 422.
[8] Kurtulmus F, Alibas I, Kavdir I. Int. J. Agric. Biol. Eng.,2016,9(1): 51.
[9] Le Cun Y, Bengio Y, Hinton G. Nature: Deep Learning,2015,521(7553): 436. |
[1] |
GAO Wei-ling, ZHANG Kai-hua*, XU Yan-fen, LIU Yu-fang*. Data Processing Method for Multi-Spectral Radiometric Thermometry Based on the Improved HPSOGA[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3659-3665. |
[2] |
CHENG Hui-zhu1, 2, YANG Wan-qi1, 2, LI Fu-sheng1, 2*, MA Qian1, 2, ZHAO Yan-chun1, 2. Genetic Algorithm Optimized BP Neural Network for Quantitative
Analysis of Soil Heavy Metals in XRF[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3742-3746. |
[3] |
FENG Ying-chao1, HUANG Yi-ming2*, LIU Jin-ping1, JIA Chen-peng2, CHEN Peng1, WU Shao-jie2*, REN Xu-kai3, YU Huan-wei3. On-Line Monitoring of Laser Wire Filling Welding Process Based on Emission Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1927-1935. |
[4] |
FENG Xin1, 2, FANG Chao1*, GONG Hai-feng2, LOU Xi-cheng1, PENG Ye1. Infrared and Visible Image Fusion Based on Two-Scale Decomposition and
Saliency Extraction[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 590-596. |
[5] |
WANG Zhi-xin, WANG Hui-hui, ZHANG Wen-bo, WANG Zhong, LI Yue-e*. Classification and Recognition of Lilies Based on Raman Spectroscopy and Machine Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 183-189. |
[6] |
CAI Yu1, 2, ZHAO Zhi-fang3, GUO Lian-bo4, CHEN Yun-zhong1, 2*, JIANG Qiong4, LIU Si-min1, 2, ZHANG Cong-zi4, KOU Wei-ping5, HU Xiu-juan5, DENG Fan6, HUANG Wei-hua7. Research on Origin Traceability of Rhizoma Dioscoreae Based on LIBS[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 138-144. |
[7] |
HU Shuang1, LIU Cui-mei2*, JIA Wei2, HUA Zhen-dong2. Rapid Qualitative Analysis of Synthetic Cannabinoids by Raman
Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 145-150. |
[8] |
YAN Wen-hao1, YANG Xiao-ying1, GENG Xin1, WANG Le-shan1, LÜ Liang1, TIAN Ye1*, LI Ying1, LIN Hong2. Rapid Identification of Fish Products Using Handheld Laser Induced Breakdown Spectroscopy Combined With Random Forest[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3714-3718. |
[9] |
DUAN Hong-wei1, 2, GUO Mei3, ZHU Rong-guang3, NIU Qi-jian1, 2. LIBS Quantitative Analysis of Calorific Value of Straw Charcoal Based on XY Bivariate Feature Extraction Strategy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3435-3440. |
[10] |
YUAN Zhuang1, DONG Da-ming2*. Near-Infrared Spectroscopy Measurement of Contrastive Variational Autoencoder and Its Application in the Detection of Liquid Sample[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3637-3641. |
[11] |
FAN Yuan-chao, CHEN Xiao-jing*, HUANG Guang-zao, YUAN Lei-ming, SHI Wen, CHEN Xi. Evaluation of Aging State of Wire Insulation Materials Based on
Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3161-3167. |
[12] |
GUO Yang1, GUO Jun-xian1*, SHI Yong1, LI Xue-lian1, HUANG Hua2, LIU Yan-cen1. Estimation of Leaf Moisture Content in Cantaloupe Canopy Based on
SiPLS-CARS and GA-ELM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(08): 2565-2571. |
[13] |
YANG Jie-kai1, GUO Zhi-qiang1, HUANG Yuan2, 3*, GAO Hong-sheng1, JIN Ke1, WU Xiang-shuai2, YANG Jie1. Early Classification and Detection of Melon Graft Healing State Based on Hyperspectral Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2218-2224. |
[14] |
LI Wei, ZHANG Xue-li, SU Qin, ZHAO Rui, SONG Hai-yan*. Qualitative Analysis of Chlorpyrifos Pesticide Residues in Cabbage Leaves Based on Visible Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 80-85. |
[15] |
CHEN Yan-ling, CHENG Liang-lun*, WU Heng*, XU Li-min, HE Wei-jian, LI Feng. A Method of Terahertz Spectrum Material Identification Based on Wavelet Coefficient Graph[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(12): 3665-3670. |
|
|
|
|