Tillering Number Estimation of Winter Wheat Based on Visible
Spectrogram and Lightweight Convolutional Neural Network
LI Yun-xia1, MA Jun-cheng2, LIU Hong-jie3, ZHANG Ling-xian1*
1. College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
2. Institute of Environment and Sustainable Development in Agriculture, Chinese Academy of Agricultural Sciences, Beijing 100081, China
3. Shangqiu Academy of Agriculture and Forestry Sciences, Shangqiu 476000, China
Abstract:Tiller number is a key trait to characterize the growth of winter wheat, which is of great significance for seedling condition monitoring and yield prediction of winter wheat. Given the complicated data acquisition and thelarge volume of the estimation model, an estimation method for the tiller number of winter wheat based on visible light images and lightweight convolutional neural networks (CNNs) was explored. It can realize nondestructive and rapid estimation of tillering numbers and can be embedded into mobile terminal devices. It can realize nondestructive and rapid estimation of tillering number of winter wheat and can be embedded into mobile terminal devices. Based on these data, lightweight CNNs MobileNetV2, SqueezeNet and ShuffleNet were used to construct the estimation model of tillering number of winter wheat. The optimization comparison test was conducted, and the comparison test was conducted with the estimation model constructed based on non-lightweight neural network AlexNet and ResNet series models. Comparison tests were conducted with estimation models constructed based on non-lightweight CNNs, AlexNet and ResNet series models. In addition, the robustness of the tillering number estimation model under different plant densities and the generalization ability of data in different growing seasons were verified. The results showed that the determination coefficient (R2) and normalized root mean square error (NRMSE) of the estimation model based on MobileNetV2 were 0.7 and 0.2, respectively, which showed the best performance among the three lightweight CNNs. The volume of the winter wheat tillering number estimation model constructed based on non-lightweight CNNs was 2.3~16.1 times that of the winter wheat tillering number estimation model constructed based on MobileNetV2. Compared with the non-lightweight CNNs, the estimation model based on MobileNetV2 had better R2 and smaller volume, which was suitable for embedding into mobile terminal devices. According to the visible image data set divided by three plant densities, 120, 270 and 420 plants ·m-2, the value of R2 of the estimation model based on MobileNetV2 were 0.8, 0.8 and 0.7, respectively, showing robust performance. For visible images of two growing seasons, the estimation model based on MobileNetV2 improved R2 by 2 times, and NRMSE decreased by 7.6% through transfer learning, showing good adaptability to seasonal differences of data and reflecting the generalization ability of the model. Therefore, based on visible light images, the lightweight CNNs estimation model can meet the tillering number estimation of winter wheat and provide an accurate, robust tool that can be embedded into mobile terminal devices for winter wheat growth observation and field agronomic measures management decisions.
李云霞,马浚诚,刘红杰,张领先. 基于可见光谱与轻量级卷积神经网络的冬小麦分蘖数估算[J]. 光谱学与光谱分析, 2023, 43(01): 273-279.
LI Yun-xia, MA Jun-cheng, LIU Hong-jie, ZHANG Ling-xian. Tillering Number Estimation of Winter Wheat Based on Visible
Spectrogram and Lightweight Convolutional Neural Network. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 273-279.
[1] ZHANG Meng, SUN Hong, LI Min-zan, et al(张 猛,孙 红,李民赞,等). Transactions of the Chinese Society of Agricultural Machinery(农业机械学报), 2016, 47(9): 341.
[2] Fang Y, Qiu X L, Guo T, et al. Plant Methods, 2020, 16(1): 132.
[3] CAO Zhong-sheng, LI Yan-da, YE Chun, et al(曹中盛,李艳大,叶 春,等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2020, 36(4): 185.
[4] González-Esquiva J M, Oates M J, García-Mateos G, et al. Computers and Electronics in Agriculture, 2017, 141: 15.
[5] MA Jun-cheng, LIU Hong-jie, ZHENG Fei-xiang, et al(马浚诚,刘红杰,郑飞翔,等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2019, 35(5): 183.
[6] Ma J C, Li Y X, Chen Y Q, et al. European Journal of Agronomy, 2019, 103: 117.
[7] Madec S, Jin X L, Lu H, et al. Agricultural and Forest Meteorology, 2019, 264: 225.
[8] Yang Q, Shi L, Han J, et al. Field Crops Research, 2019, 235(3):142.
[9] Iandola F N, Han S, Moskewicz M W, et al. IEEE Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016.
[10] FENG Xiao, LI Dan-dan, WANG Wen-jun,et al(冯 晓,李丹丹,王文君,等). Journal of Henan Agricultural Sciences(河南农业科学), 2021, 50(4): 174.
[11] LÜ Shi-lei, LU Si-hua, LI Zhen, et al(吕石磊,卢思华,李 震,等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2019, 35(17): 205.
[12] Pradana-López S, Pérez-Calabuig A M, Rodrigo C, et al. Food Control, 2021,(4): 108122.