|
|
|
|
|
|
Research on Classification Method of Hybrid Rice Seeds Based on the Fusion of Near-Infrared Spectra and Images |
YE Wen-chao1, LUO Shui-yang1, LI Jin-hao1, LI Zhao-rong1, FAN Zhi-wen1, XU Hai-tao1, ZHAO Jing1, LAN Yu-bin1, 2, DENG Hai-dong1*, LONG Yong-bing1, 2, 3* |
1. College of Electronic Engineering/College of Artificial Intelligence, National Center for International Collaboration Research on Precision Agricultural Aviation Pesticides Spraying Technology, South China Agricultural University, Guangzhou 510642, China
2. Guangdong Laboratory for Lingnan Modern Agriculture, Guangzhou 510642, China
3. South China Intelligent Agriculture Public R&D (Research & Development) Platform,Ministry of Agriculture and Rural Affairs, Guangzhou 510520, China
|
|
|
Abstract With the rapid development of hybrid rice breeding technology, hybrid rice varieties are becoming increasingly diverse, and their quality and price vary widely. The use of intelligent means for rapid classification, grading and quality detection of hybrid rice seeds has become a hot spot in hybrid rice research. In this paper, we first investigate the effect of different preprocessing methods on the accuracy of a 1D Convolutional Neural Network (1D-CNN) classification model constructed based on the near-infrared spectra of 10 hybrid rice seeds. The results show that the overall validation and prediction accuracy can be up to 95.4% and 92.9% respectively when the near-infrared spectra are preprocessed with the Savitzky-Golay convolution smoothing algorithm (SG). Secondly, the three most important feature wavelengths were selected by the random forest feature wavelength selection algorithm to build a single-wavelength grayscale image dataset and a 3-wavelength reconstructed pseudo-color image dataset, and the hybrid rice seed classification model based on the convolutional neural network VGG and the residual network ResNet of the image dataset was constructed and studied. The results show that the VGG model based on the pseudo-color image dataset can obtain the optimal classification effect, and the classification accuracies of its validation set and test set are 92.8% and 92.8%, respectively. Compared with the ResNet classification model based on the pseudo-color image dataset, an improved value of 3.6% is achievedin the validation set and 4.9% in the test set. In order to further improve the classification accuracy, a hybrid rice seed classification method based on the fusion of image information and spectral information is proposed. This methodextracts spectral features using the 1D-CNN network branch and extracts dimensionalspatial features using the 2D-CNN network branch. 2Branches-CNN model is then constructed based on the fusion of image and spectral features, and the classification accuracy reaches high values of 98% and 96.7% for the validation set and test set. The classification effect of the 2Branch-CNN model for each type of hybrid rice seeds is also evaluated by calculating the confusion matrix. The results of this paper show that the classification accuracy of the convolutional neural network model can be effectively improved by image-spectrum fusion, and the construction of a two-branch convolutional neural network model based on image-spectrum fusion will provide new ideas for rapid screening and classification of hybrid seed varieties.
|
Received: 2022-05-04
Accepted: 2023-02-15
|
|
Corresponding Authors:
DENG Hai-dong, LONG Yong-bing
E-mail: dhdong@scau.edu.cn;yongbinglong@126.com
|
|
[1] XIE Fang-ming, PENG Shao-bing(谢放鸣,彭少兵). Science Bulletin (科学通报), 2016, 61(35): 3858.
[2] ZHU De-feng, ZHANG Yu-ping, CHEN Hui-zhe(朱德峰,张玉屏,陈惠哲, 等). Scientia Agricultura Sinica(中国业科学), 2015, 48(17): 3404.
[3] Yang G Y, Wang Q Y, Liu C, et al. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 2018, 200: 186.
[4] LIU Xiao-dan, FENG Xu-ping, LIU Fei, et al(刘小丹,冯旭萍,刘 飞, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2017, 33(22): 189.
[5] PENG Yan-kun, ZHAO Fang, LI Long, et al(彭彦昆,赵 芳,李 龙, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2018, 34(5): 159.
[6] YUE Jia-ming, CONG Xiao-xiang, LI Man-li(岳佳铭,丛晓翔,李曼莉). Seed(种子), 2021, 40(10): 129.
[7] Li H, Jia S, Le Z. Sensors, 2019, 19(20): 4355.
[8] Gutiérrez S, Wendel A, Underwood J. Computers and Electronics in Agriculture, 2019, 157: 126.
[9] Zhang X, Liu F, He Y, et al. Sensors (Basel, Switzerland), 2012, 12(12): 17234.
[10] YIN Wen-jun, RU Chen-lei, ZHENG Jie, et al(殷文俊,茹晨雷,郑 洁,等). China Journal of Chinese Materia Medica(中国中药杂志), 2021, 46(4): 923.
[11] Li P, Zhang X, Li S, et al. Sensors, 2020, 20(6): 1586.
[12] WANG Cheng-kun, ZHAO Peng(王承琨,赵 鹏). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2021, 41(6): 1713.
[13] He X T, Feng X P, Sun D W, et al. Molecules, 2019, 24(12): 2227.
[14] Baek I, Kim M S, Cho B K, et al. Applied Sciences, 2019, 9(5): 1027.
[15] WANG Liu-san, HUANG Zi-liang, WANG Ru-jing(汪六三,黄子良,王儒敬). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2021, 52(6): 361.
[16] Zhang L, Rao Z H, Ji H Y, et al. Sensors, 2019, 19(14): 3147.
[17] Genuer R, Poggi J M, Tuleau-Malot C. Pattern Recognition Letters, 2016, 31(14): 2225.
[18] Yao R, Li J, Hui M, et al. IEEE Access, 2020, 8: 159151.
[19] Zhu Y L, Duan J M, Li Y H, et al. Textile Research Journal, 2022, 92(7-8): 1012.
[20] LIU Shu, JIANG Qi-gang, MA Yue, et al(刘 舒,姜琦刚,马 玥, 等). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2017, 48(1): 119.
[21] ZHANG Wen-jie, JIAO An-ran, TIAN Jing, et al(张文杰,焦安然,田 静,等). Journal of Instrumental Analysis(分析测试学报), 2021, 40(7): 6.
[22] ZHAI Nai-qi, YUN Li-jun, YE Zhi-xia, et al(翟乃琦,云利军,叶志霞, 等). Computer Engineering & Science(计算机工程与科学), 2021, 43(10): 1833.
[23] Li Z, Li F, Zhu L, et al. International Journal of Computational Intelligence Systems, 2020, 13(1): 559.
[24] QI Chao, ZUO Yi, CHEN Zhe-qi, et al(戚 超,左 毅,陈哲琪, 等). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2021, 52(5): 301.
[25] ZHANG Yao-xin, ZHU Rong-guang, MENG Ling-feng, et al(张垚鑫,朱荣光,孟令峰, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2021, 37(18): 331.
[26] Xie W J, Wei S, Zheng Z H, et al. Food and Bioprocess Technology, 2021, 14(7): 1361. |
[1] |
ZHU Wen-jing1, 2,FENG Zhan-kang1, 2,DAI Shi-yuan1, 2,ZHANG Ping-ping3,JI Wen4,WANG Ai-chen1, 2,WEI Xin-hua1, 2*. Multi-Feature Fusion Detection of Wheat Lodging Information Based on UAV Multispectral Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 197-206. |
[2] |
WANG Yu-chen1, 2, KONG Ling-qin1, 2, 3*, ZHAO Yue-jin1, 2, 3, DONG Li-quan1, 2, 3*, LIU Ming1, 2, 3, HUI Mei1, 2. Hyperspectral Reconstruction From RGB Images for Tissue Oxygen
Saturation Assessment[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 3193-3201. |
[3] |
YANG Sen1, ZHANG Xin-ao1, XING Jian1, DAI Jing-min2. Study on Multi-Feature Model Fusion Variety Classification and Multi-Parameter Appearance Inspection for Milled Rice[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2837-2842. |
[4] |
ZHANG Zhi-fen1, LIU Zi-min1, QIN Rui1, LI Geng1, WEN Guang-rui1, HE Wei-feng2. Real-Time Detection of Protective Coating Damage During Laser Shock Peening Based on ReliefF Feature Weight Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2437-2445. |
[5] |
YANG Dong-feng1, HU Jun2*. Accurate Identification of Maize Varieties Based on Feature Fusion of Near Infrared Spectrum and Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2588-2595. |
[6] |
TANG Ting, PAN Xin*, LUO Xiao-ling, GAO Xiao-jing. Fusion of ConvLSTM and Multi-Attention Mechanism Network for
Hyperspectral Image Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2608-2616. |
[7] |
MAO Yi-lin1, LI He1, WANG Yu1, FAN Kai1, SUN Li-tao2, WANG Hui3, SONG Da-peng3, SHEN Jia-zhi2*, DING Zhao-tang1, 2*. Quantitative Judgment of Freezing Injury of Tea Leaves Based on Hyperspectral Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2266-2271. |
[8] |
ZHONG Jing-jing1, 2, LIU Xiao1, 3, WANG Xue-ji1, 3, LIU Jia-cheng1, 3, LIU Hong1, 3, QI Chen1, 3, LIU Yu-yang1, 2, 3, YU Tao1, 3*. A Multidimensional Information Fusion Algorithm for Polarization
Spectrum Reconstruction Based on Nonsubsampled Contourlet
Transform[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1254-1261. |
[9] |
LIU Si-qi1, FENG Guo-hong1*, TANG Jie2, REN Jia-qi1. Research on Identification of Wood Species by Mid-Infrared Spectroscopy Based on CA-SDP-DenseNet[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 814-822. |
[10] |
LENG Si-yu1, 2, QIAO Jia-hui1, WANG Lian-qing3, WANG Jun1, 2*, ZOU Liang1. Rapid Qualitative Analysis of Wool Content Based on Improved
U-Net++ and Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 303-309. |
[11] |
FU Peng-you1, 2, WEN Yue2, ZHANG Yu-ke3, LI Ling-qiao1*, YANG Hui-hua1, 2*. Deep Learning Modelling and Model Transfer for Near-Infrared Spectroscopy Quantitative Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 310-319. |
[12] |
CUI De-jian1, LIU Yang-yang1, XIA Yuan-tian1, JIA Wei-e1, LIAN Zheng-xing2, LI Lin1*. Non-Destructive Detection of Egg Fertilization Status Based on Hyperspectral Diffuse Reflectance[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3685-3691. |
[13] |
NI Shuang, WEN Jia-xing, ZHOU Min-jie, HUANG Jing-lin, LE Wei, CHEN Guo, HE Zhi-bing, LI Bo, ZHAO Song-nan, ZHAO Zong-qing, DU Kai*. Theoretical Study on Raman Characteristic Peaks of Coronavirus Spike Protein Based on Deep Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(09): 2757-2762. |
[14] |
ZHANG Fu-jie, SHI Lei, LI Li-xia*, ZHAO Hao-ran, ZHU Yin-long. Study on Nondestructive Identification of Panax Notoginseng Powder Quality Grade Based on Hyperspectral Imaging Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2255-2261. |
[15] |
WANG Cheng-kun2, 3, ZHAO Peng1, 2*, LI Xiang-hua2. Similar Wood Species Classification Within Pterocarpus Genus Using Feature Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2247-2254. |
|
|
|
|