Research on Classification Method of Hybrid Rice Seeds Based on the Fusion of Near-Infrared Spectra and Images
YE Wen-chao1, LUO Shui-yang1, LI Jin-hao1, LI Zhao-rong1, FAN Zhi-wen1, XU Hai-tao1, ZHAO Jing1, LAN Yu-bin1, 2, DENG Hai-dong1*, LONG Yong-bing1, 2, 3*
1. College of Electronic Engineering/College of Artificial Intelligence, National Center for International Collaboration Research on Precision Agricultural Aviation Pesticides Spraying Technology, South China Agricultural University, Guangzhou 510642, China
2. Guangdong Laboratory for Lingnan Modern Agriculture, Guangzhou 510642, China
3. South China Intelligent Agriculture Public R&D (Research & Development) Platform，Ministry of Agriculture and Rural Affairs, Guangzhou 510520, China
Abstract With the rapid development of hybrid rice breeding technology, hybrid rice varieties are becoming increasingly diverse, and their quality and price vary widely. The use of intelligent means for rapid classification, grading and quality detection of hybrid rice seeds has become a hot spot in hybrid rice research. In this paper, we first investigate the effect of different preprocessing methods on the accuracy of a 1D Convolutional Neural Network (1D-CNN) classification model constructed based on the near-infrared spectra of 10 hybrid rice seeds. The results show that the overall validation and prediction accuracy can be up to 95.4% and 92.9% respectively when the near-infrared spectra are preprocessed with the Savitzky-Golay convolution smoothing algorithm (SG). Secondly, the three most important feature wavelengths were selected by the random forest feature wavelength selection algorithm to build a single-wavelength grayscale image dataset and a 3-wavelength reconstructed pseudo-color image dataset, and the hybrid rice seed classification model based on the convolutional neural network VGG and the residual network ResNet of the image dataset was constructed and studied. The results show that the VGG model based on the pseudo-color image dataset can obtain the optimal classification effect, and the classification accuracies of its validation set and test set are 92.8% and 92.8%, respectively. Compared with the ResNet classification model based on the pseudo-color image dataset, an improved value of 3.6% is achievedin the validation set and 4.9% in the test set. In order to further improve the classification accuracy, a hybrid rice seed classification method based on the fusion of image information and spectral information is proposed. This methodextracts spectral features using the 1D-CNN network branch and extracts dimensionalspatial features using the 2D-CNN network branch. 2Branches-CNN model is then constructed based on the fusion of image and spectral features, and the classification accuracy reaches high values of 98% and 96.7% for the validation set and test set. The classification effect of the 2Branch-CNN model for each type of hybrid rice seeds is also evaluated by calculating the confusion matrix. The results of this paper show that the classification accuracy of the convolutional neural network model can be effectively improved by image-spectrum fusion, and the construction of a two-branch convolutional neural network model based on image-spectrum fusion will provide new ideas for rapid screening and classification of hybrid seed varieties.
Corresponding Authors:
DENG Hai-dong, LONG Yong-bing
E-mail: dhdong@scau.edu.cn；yongbinglong@126.com
Cite this article:
YE Wen-chao,LUO Shui-yang,LI Jin-hao, et al. Research on Classification Method of Hybrid Rice Seeds Based on the Fusion of Near-Infrared Spectra and Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2935-2941.
[1] XIE Fang-ming, PENG Shao-bing(谢放鸣，彭少兵). Science Bulletin (科学通报), 2016, 61(35): 3858.
[2] ZHU De-feng, ZHANG Yu-ping, CHEN Hui-zhe(朱德峰，张玉屏，陈惠哲, 等). Scientia Agricultura Sinica(中国业科学), 2015, 48(17): 3404.
[3] Yang G Y, Wang Q Y, Liu C, et al. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 2018, 200: 186.
[4] LIU Xiao-dan, FENG Xu-ping, LIU Fei, et al(刘小丹，冯旭萍，刘 飞, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2017, 33(22): 189.
[5] PENG Yan-kun, ZHAO Fang, LI Long, et al(彭彦昆，赵 芳，李 龙, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2018, 34(5): 159.
[6] YUE Jia-ming, CONG Xiao-xiang, LI Man-li(岳佳铭，丛晓翔，李曼莉). Seed(种子), 2021, 40(10): 129.
[7] Li H, Jia S, Le Z. Sensors, 2019, 19(20): 4355.
[8] Gutiérrez S, Wendel A, Underwood J. Computers and Electronics in Agriculture, 2019, 157: 126.
[9] Zhang X, Liu F, He Y, et al. Sensors (Basel, Switzerland), 2012, 12(12): 17234.
[10] YIN Wen-jun, RU Chen-lei, ZHENG Jie, et al(殷文俊，茹晨雷，郑 洁，等). China Journal of Chinese Materia Medica(中国中药杂志), 2021, 46(4): 923.
[11] Li P, Zhang X, Li S, et al. Sensors, 2020, 20(6): 1586.
[12] WANG Cheng-kun, ZHAO Peng(王承琨，赵 鹏). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2021, 41(6): 1713.
[13] He X T, Feng X P, Sun D W, et al. Molecules, 2019, 24(12): 2227.
[14] Baek I, Kim M S, Cho B K, et al. Applied Sciences, 2019, 9(5): 1027.
[15] WANG Liu-san, HUANG Zi-liang, WANG Ru-jing(汪六三，黄子良，王儒敬). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2021, 52(6): 361.
[16] Zhang L, Rao Z H, Ji H Y, et al. Sensors, 2019, 19(14): 3147.
[17] Genuer R, Poggi J M, Tuleau-Malot C. Pattern Recognition Letters, 2016, 31(14): 2225.
[18] Yao R, Li J, Hui M, et al. IEEE Access, 2020, 8: 159151.
[19] Zhu Y L, Duan J M, Li Y H, et al. Textile Research Journal, 2022, 92(7-8): 1012.
[20] LIU Shu, JIANG Qi-gang, MA Yue, et al(刘 舒，姜琦刚，马 玥, 等). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2017, 48(1): 119.
[21] ZHANG Wen-jie, JIAO An-ran, TIAN Jing, et al(张文杰，焦安然，田 静，等). Journal of Instrumental Analysis(分析测试学报), 2021, 40(7): 6.
[22] ZHAI Nai-qi, YUN Li-jun, YE Zhi-xia, et al(翟乃琦，云利军，叶志霞, 等). Computer Engineering & Science(计算机工程与科学), 2021, 43(10): 1833.
[23] Li Z, Li F, Zhu L, et al. International Journal of Computational Intelligence Systems, 2020, 13(1): 559.
[24] QI Chao, ZUO Yi, CHEN Zhe-qi, et al(戚 超，左 毅，陈哲琪, 等). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2021, 52(5): 301.
[25] ZHANG Yao-xin, ZHU Rong-guang, MENG Ling-feng, et al(张垚鑫，朱荣光，孟令峰, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2021, 37(18): 331.
[26] Xie W J, Wei S, Zheng Z H, et al. Food and Bioprocess Technology, 2021, 14(7): 1361.
