|
|
|
|
|
|
Segmentation Method for Crop Leaf Spot Based on Semantic Segmentation and Visible Spectral Images |
LI Kai-yu1, ZHANG Hui2, MA Jun-cheng3, ZHANG Ling-xian1* |
1. College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
2. College of Information and Management Science, Henan Agricultural University, Zhengzhou 450018, China
3. Institute of Environment and Sustainable Development in Agriculture, Chinese Academy of Agricultural Sciences, Beijing 100081, China
|
|
|
Abstract Diseases affect crop quality seriously and cause economic losses. Disease spot segmentation is an important process of identification and disease severity estimation, whose segmentation results can provide an effective basis for subsequent identification and severity estimation. Due to the irregularity and complexity of lesions, and the visible spectrum image of lesions in the natural environment is susceptible to be change in illumination, traditional image processing methods have low accuracy, low universality and robustness for image segmentation of lesions. In this regard, this article proposed a method for the segmentation of crop leaf diseases based on semantic segmentation and visible spectrum images. Firstly, taking peanut brown spot and tobacco brown spot as the research objects, 165 visible spectrum images were collected using a Nikon D300s SLR camera. The visible spectrum images of the diseases were pixel-labeled through the Matlab Image Labeler APP, and the brown spot and background area were respectively marked. Secondly, the labeled dataset adopted image enhancement methods such as horizontal flipping, vertical flipping, changing brightness, etc., to obtain 1 850 enhanced sample data sets and randomly divided them into the training set, validation set and test set according to the ratio of 8∶1∶1. At the same time, in order to save computational cost, the pixel resolution of the data set was adjusted to 300×300. Finally, four types of disease spot segmentation models were constructed based on the three semantic segmentation networks of FCN, SegNet and U-Net. The effects of data enhancement and disease types on the lesion segmentation model were explored. Four segmentation indicators were used to evaluate the model’s segmentation effect. The test results showed that only for lesion segmentation, image enhancement could improve the segmentation accuracy of the model. The model’s Mean Precision (MP) and Mean Intersection over Union (MIoU) were 95.71% and 93.36%, respectively. The 4 semantic segmentation models were significantly better than the Support Vector Machine (SVM). Compared with the U-Net, SegNet-2 and SegNet-4 segmentation models, FCN can effectively avoid the influence of light changes. The Precision (P) of lesion segmentation and the Intersection over Union(IoU) reached 99.25% and 97.55%, respectively. For the lesion classification and segmentation experiment, the Precision (P) of FCN for the two diseases reached 90.41% and 97.54%, and the Intersection over Union(IoU) of the two diseases reached 95.61% and 70.30%, respectively, which were better than the other three segmentation models. FCN can distinguish disease types well while segmenting disease spots, which has good generalization and robustness and realize the identification and segmentation of disease spots in natural scenes and provide a technical reference for the severity estimation of mixed diseases.
|
Received: 2022-02-08
Accepted: 2022-05-27
|
|
Corresponding Authors:
ZHANG Ling-xian
E-mail: zhanglx@cau.edu.cn
|
|
[1] Ma J, K Du, Zheng F, et al. Computers and Electronics in Agriculture, 2018, 154: 18.
[2] Zhang S, You Z, Wu X. Neural Computing and Applications, 2019, 31(2): 1225.
[3] Zhang S, Wu X, You Z, et al. Computers and Electronics in Agriculture, 2017, 134: 135.
[4] LIAO Juan, CHEN Min-hui, ZHANG Kai, et al(廖 娟,陈民慧,张 锴,等). Transactions of the Chinese Society of Agricultural Machinery(农业机械学报), 2021, 52(12): 171.
[5] Alencastre M M, Johnson R R, Krebs H I. IEEE Transactions on Industrial Informatics, 2021, 17(2): 787.
[6] Xiong L, Zhang D, Li K, et al. Soft Computing, 2020, 24(10): 7253.
[7] Chen L C, Papandreou G, Kokkinos I, et al. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(4): 834.
[8] CHEN Yan, ZHU Cheng-yu, HU Xiao-chun, et al(陈 燕,朱成宇,胡小春,等). Transactions of the Chinese Society of Agricultural Machinery(农业机械学报), 2021, 52(7): 169.
[9] WANG Can, WU Xin-hui, ZHANG Yan-qing, et al(王 璨,武新慧,张燕青,等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2021, 37(9): 211.
[10] GU Xing-jian, ZHU Jian-feng, REN Shou-gang, et al(顾兴健,朱剑峰,任守纲,等). Computer Science(计算机科学), 2021, 48(S2): 360.
[11] SUN Jun, TAN Wen-jun, WU Xiao-hong, et al(孙 俊,谭文军,武小红,等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2019, 35(12): 184.
[12] Li Y X, Liu H J, Ma J C, et al. Computers and Electronics in Agriculture, 2021, 190: 106480.
|
[1] |
GAO Feng1, 2, XING Ya-ge3, 4, LUO Hua-ping1, 2, ZHANG Yuan-hua3, 4, GUO Ling3, 4*. Nondestructive Identification of Apricot Varieties Based on Visible/Near Infrared Spectroscopy and Chemometrics Methods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 44-51. |
[2] |
CHEN Chao-yang1, 2, LIU Cui-hong1, 2, LI Zhi-bin3, Andy Hsitien Shen1, 2*. Alexandrite Effect Origin of Gem Grade Diaspore[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2557-2562. |
[3] |
LI Shu-fei1, LI Kai-yu1, QIAO Yan2, ZHANG Ling-xian1*. Cucumber Disease Detection Method Based on Visible Light Spectrum and Improved YOLOv5 in Natural Scenes[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2596-2600. |
[4] |
ZHANG Jing, GUO Zhen, WANG Si-hua, YUE Ming-hui, ZHANG Shan-shan, PENG Hui-hui, YIN Xiang, DU Juan*, MA Cheng-ye*. Comparison of Methods for Water Content in Rice by Portable Near-Infrared and Visible Light Spectrometers[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2059-2066. |
[5] |
XU Ji-tong1, JIN Hai-rong1, TONG Wen-yu1, ZHANG Zhe1, GUO Yu-hang1, TIAN Su-bo1. 2, NING Xiao-feng1, 2*. Segmentation and Detection of Cucumber Powdery Mildew by Comparison of Near-Infrared and Fluorescence Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1731-1738. |
[6] |
WANG Zi-min1, MAO Xiao-tian1, YIN Zuo-wei1*, CHEN Chang2, CHENG Tian-jia1. Study on the Spectral Characteristics and the Color-Change Effect of Spinel[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3541-3545. |
[7] |
XIN Hong-juan1, YANG Dong-ling1, HAN Chao-qun1, GU Xue-qi1, YANG Jian-jun2, LIU Jin1*, CHEN Yuan-quan1, SUI Peng1. Molecular Characterization of Phosphorus in Typical Crop Residues[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2304-2308. |
[8] |
WU Jing-zhu1, LI Xiao-qi1, SUN Li-juan2, LIU Cui-ling1, SUN Xiao-rong1, YU Le1. Advances in the Application of Terahertz Time-Domain Spectroscopy and Imaging Technology in Crop Quality Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 358-367. |
[9] |
REN Qian-qian1*, YUAN Yi-chai2. Study on Spectroscopy of Sphene From Pakistan[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2263-2268. |
[10] |
YU Xin-hua1, ZHAO Wei-qing2*, ZHU Zai-chun2, XU Bao-dong3, ZHAO Zhi-zhan4. Research in Crop Yield Estimation Models on Different Scales Based on Remote Sensing and Crop Growth Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2205-2211. |
[11] |
WANG Xiang-yu1, LI Hai-sheng1, LÜ Li-jun1, HAN Dan-feng1, WANG Zi-qiang2*. Segmentation of Cucumber Target Leaf Spot Based on U-Net and Visible Spectral Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(05): 1499-1504. |
[12] |
CHEN Chao-yang1,HUANG Wei-zhi1,SHAO Tian1,LI Zhi-bin2,Andy Hsitien Shen1*. Characteristics of Visible Spectrum of Apatite With Alexandrite Effect[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(05): 1483-1486. |
[13] |
YAN Hui, LI Xin-ping, XU Zhu, LIN Guo-sen. Applications of Fluorescence Analysis Technology on Study of Crop Response to Cadmium Stress[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(10): 3118-3122. |
[14] |
HUANG Ping-jie, LI Yu-han, YU Qiao-jun, WANG Ke, YIN Hang, HOU Di-bo*, ZHANG Guang-xin. Classification of Organic Contaminants in Water Distribution Systems Developed by SPA and Multi-Classification SVM Using UV-Vis Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(07): 2267-2272. |
[15] |
JI Yang-pei1, YANG Ying1*, LIU Gang1,2,3. Recognition of Pig Eating and Drinking Behavior Based on Visible Spectrum and YOLOv2[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(05): 1588-1594. |
|
|
|
|