1. School of Information and Electrical Engineering, Ludong University, Yantai 264025, China
2. School of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
Abstract：At present, Convolutional Neural Network (CNN) has made a breakthrough in species recognition. As an important part of the agricultural economy, shellfish has a wide variety of species with complex characteristics. Some of the shellfish are highly similar and the distribution of various samples is unbalanced, which causes a low accuracy of CNN classification. In view of this situation, a shellfish recognition method based on visible spectrum and CNN is proposed in this paper, which aims to extract more effective shellfish features to improve the classification accuracy of shellfish. Firstly, a filter information measurement and feature selection method including output entropy measurement and orthogonality measurement is proposed, which reinitializes the pruned filter and makes it orthogonality, captures different directions in the network activation space, so that the neural network model can learn more useful shellfish feature information and improve the classification accuracy of the model; secondly, a shellfish classification objective function including regularization term and focal loss term is proposed, which reduces the weight of easily classified samples by controlling the shared weight of each sample to the total loss, it tilts the attention of the model to the samples with inaccurate prediction, so as to balance the distribution of samples and the difficulty of sample classification, and improve the accuracy of shellfish classification. The shellfish image dataset in this paper consists of 74 shellfish species with 11 803 pictures in total. After obtaining the original dataset, data augmentation which consists of horizontal flipping, vertical flipping, random rotation, rotation within the range of [0, 30°], scaling and moving within the range of [0, 20%] and moving is performed on the images of the dataset, increasing the number of images from 11 803 to 119 964. The whole image dataset is randomly divided into training set with 95 947 pictures, validation set with 11 996 pictures and test set with 12 021 pictures in an 8∶1∶1 ratio. In this paper, based on the establishment of the shellfish image dataset, the experimental verification has reached the classification accuracy of 93.38%, which increases the accuracy of the benchmark network (Resnest) by 1.18%. Compared with SN_Net, and MutualNet, the accuracy of the proposed method is increased by 4.34% and 0.85%, respectively. And the training time is 22 320 seconds, which shortens the training time of the benchmark network (Resnest) by 960 seconds, the training time of the proposed method is 3 180 seconds and 2 460 seconds shorter than SN_Net and MutualNet, respectively. The experiments results demonstrate the effectiveness of the proposed method.
Key words：Convolutional neural network; Shellfish recognition; Filter information measurement; Feature selection; Shellfish classification objective function
[1] HAO Hui-min, LIANG Yong-guo, WU Hai-bin, et al（郝惠敏, 梁永国, 武海彬, 等）. Spectroscopy and Spectral Analysis（光谱学与光谱分析）, 2021, 41(3): 782.
[2] Wang Z, Qi Y, Ma J L Z. User Intension Understanding from Scratch, Processing and Learning for Intelligent Machines (SPLINE), 2016: 1, doi: 10.1109/SPLIM.2016.7528398.
[3] ZHAO Qing, WU Biao, LIU Zhi-hong, et al(赵 庆, 吴 彪, 刘志鸿, 等). Journal of Fishery Sciences of China(中国水产科学), 2018, 25(4): 847.
[4] Li G, Li Z, Zhang C, et al. Shellfish Detection Based on Fusion Attention Mechanism in End-to-End Network, Proceedings of Pattern Recognition and Computer Vision(PRCV), 2019. 516.
[5] Molchanov P, Mallya A, Tyree S, et al. Importance Estimation for Neural Network Pruning, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019. 11264.
[6] Suau X, Zappella L, Palakkode V, et al. Filter Distillation for Network Compression, 2018, arXiv: 2004. 08955.
[7] Ma N, Zhang X, Zheng H T, et al. ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design, European Conference on Computer Vision(ECCV), 2018. 116.
[8] Lemaire C, Achkar A, Jodoin P-M. Structured Pruning of Neural Networks With Budget-Aware Regularization, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019. 9108.
[9] Yu J, Yang L, Xu N, et al. Slimmable Neural Networks, 7th International Conference on Learning Representations, ICLR 2019.
[10] Yu J, Huang T S. Universally Slimmable Networks and Improved Training Techniques, Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019. 1803.
[11] Cai H, Gan C, Wang T, et al. Once-For-All: Train One Network and Specialize It for Efficient Deployment, International Conference on Learning Representations(ICLR), 2020.
[12] Yang T, Zhu S, Yan S, et al. MutualNet: Adaptive ConvNet via Mutual Learning from Network Width and Resolution, European Conference on Computer Vision(ECCV), 2020. 299.
[13] Zhang H, Wu C, Zhang Z, et al. ResNest: Split-Attention Networks, 2020, arXiv: 2004. 08955.
