|
|
|
|
|
|
Improved YOLOv4 Remote Sensing Image Detection Method of Ground Objects Along Railway |
WANG Yang-ping1, 2, HAN Shu-mei1*, YANG Jing-yu1, 2, DANG Jian-wu1, 2, ZHANG Zhan-ping1 |
1. School of Electronic and Information Engineering,Lanzhou Jiaotong University,Lanzhou 730070,China
2. Gansu Engineering Research Center for Artificial Intelligence and Graphic & Image Processing,Lanzhou 730070,China
|
|
|
Abstract In recent years, the rapid development of high-resolution remote sensing technology has provided an effective technical means for detecting ground objects along the railway. The regression-based one-stage target detection method YOLOv4 has the advantages of high detection accuracy and fast speed. However, when it is used for remote sensing image detection, small targets are still missed due to the loss of some detailed feature information, and large-area ground object detection. Due to the problem of low efficiency, this paper improves the YOLOv4 network model to detect ground objects along the railway in remote sensing images. This paper improves the YOLOv4 network model to detect the ground features in remote sensing images along the railway. First, the CBM (Convolution Batch Normalization Mish) module is designed with composing of convolution, batch normalization, and Mish activation, and the DCBM (Double CBM) module is used for the transmission layer of the densely connected network (DenseNet) for the YOLOv4 network feature extraction. It can achieve feature transfer and information reuse and enhance small target feature detection capabilities. Then, to address the defects of YOLOv4 in the inefficiency of large area detection and the large space of model parameters, the SE (Squeeze Excitation) channel attention mechanism is used after each residual cell of Cross Stage Partial (CSP) in the backbone network to reduce the number of repeated calls of the SE attention module. Hence the performance of the network is improved while reducing the number of model parameters and improving detection efficiency. Finally, for the problem of difficult extraction of railroad targets in images, an improved channel space attention mechanism ICBAM (Improved Convolutional Block Attention Module) is introduced before the network result output to retain the original feature information. It can solve the problem of poor feature extraction ability of railroad targets, and improve the detection efficiency of large-scale targets. To verify the effectiveness of the proposed method, 1 676 remote sensing image samples are selected along a particular section of the railway with a resolution of 1 920×1 080. Railways, houses, buildings, farmland, and ponds in the data set are selected as targets for inspection, and some current popular target detection methods are compared. The experimental results show that the improved method enhances the detection ability of small targets, improves the accuracy and speed of detection, and improves the detection efficiency of large-scale targets. Compared with the YOLOv4 algorithm, the improved method mAP has increased by 2.11%, accuracy increased by 2.93%, the recall rate has increased by 3.79%, and the model size is reduced by 8.53%. The proposed method also provides an effective method for rapidly and accurately detecting ground objects in remote sensing images along the high-speed railway.
|
Received: 2021-08-23
Accepted: 2022-03-01
|
|
Corresponding Authors:
HAN Shu-mei
E-mail: 0219653@stu.lzjtu.edu.cn
|
|
[1] YIN Zi-yao, LI Jun-sheng, FAN Hai-sheng, et al(殷子瑶, 李俊生, 范海生, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2021, 41(2): 494.
[2] Konstantinidis D, Argyriou V, Stathaki T, et al. Computer Networks, 2020, 168: 107034.
[3] Wang P, Sun X, Diao W, et al. IEEE Transactions on Geoscience and Remote Sensing, 2019, 58(5): 3377.
[4] Xu D, Wu Y. Remote Sensing, 2021, 13(7): 1311.
[5] Li M, Zhang Z, Lei L, et al. Sensors, 2020, 20(17): 4938.
[6] Bochkovskiy A, Wang C Y, Liao H Y M. YOLOv4: Optinal Spped and Accuracy of Object Detection, arXiv: 2004. 10934, 2020.
[7] Yin Fulian, Li Sitong, Ji Meiqi, et al. Applied Intelligence, 2022, 52(1): 19.
[8] BIAN Ji-long, WANG Hou-bo, LI Jin-feng(边继龙,王厚博,李金凤). Journal of Beijing University of Posts and Telecommunications(北京邮电大学学报), 2021, 44(3):27.
[9] Li H, Deng L, Yang C, et al. IEEE Access, 2021, 16692: 16706.
[10] Zhang Z, Liu Y, Liu T, et al. IEEE Geoscience and Remote Sensing Letters, 2019, 17(11): 1884.
[11] Chen L, Shi W, Deng D. Remote Sensing, 2021, 13(4): 660.
|
[1] |
TAO Jing-zhe1, 3, SONG De-rui1, 3, SONG Chuan-ming2, WANG Xiang-hai1, 2*. Multi-Band Remote Sensing Image Sharpening: A Survey[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 2999-3008. |
[2] |
DENG Yun1, 2, NIU Zhao-wen1, 2, FENG Qi-yao1, 2, WANG Yu1, 2*. A Novel Hyperspectral Prediction Model of Organic Matter in Red Soil Based on Improved Temporal Convolutional Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2942-2951. |
[3] |
SUN Bang-yong1, YU Meng-ying1, YAO Qi2*. Research on Spectral Reconstruction Method From RGB Imaging Based on Dual Attention Mechanism[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2687-2693. |
[4] |
WU Kuang, SUN Chun, CAO Guan-long*, QIU Bo*, YAO Lin, ZHANG Ming-ru, ZHANG Li-wen. An Algorithm for Redshift Estimation of Photometric Images Using
Convolutional Neural Networks[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2529-2535. |
[5] |
TANG Ting, PAN Xin*, LUO Xiao-ling, GAO Xiao-jing. Fusion of ConvLSTM and Multi-Attention Mechanism Network for
Hyperspectral Image Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2608-2616. |
[6] |
WU Zhi-yu1, XIN Zhi-ming2, JIANG Qun-ou1*, YU Yang1, WANG Zi-xuan1. Analysis of Dust Source and Dust Transport Path of a Typical Dust Event in Arid Area of Northwest China Based on HYSPLIT Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1862-1868. |
[7] |
SUN Xi-tong, FU Yun*, HAN Chun-xiao, FAN Yu-hua, WANG Tian-shu. An Inversion Method for Chlorophyll-a Concentration in Global Ocean Through Convolutional Neural Networks[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 608-613. |
[8] |
GAO Feng1, 2, 3, JIANG Qun-ou1, 2, 3*, XIN Zhi-ming4, XIAO Hui-jie1, 2, LÜ Ke-xin1, QIAO Zhi1. Extraction Method of Oasis Shelterbelt Systems Based on Remote-Sensing Images ——A Case Study of Dengkou County[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3896-3905. |
[9] |
LIU Hong-jun1, NIU Teng1, YU Qiang1*, SU Kai2, YANG Lin-zhe1, LIU Wei1, WANG Hui-yuan1. Inversion and Estimation of Heavy Metal Element Content in Peach Forest Soil in Pinggu District of Beijing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3552-3558. |
[10] |
XU Xue-bin1, 2, XING Xiao-min1, 2*, AN Mei-juan1, 2, CAO Shu-xin1, 2, MENG Kan1, 2, LU Long-bin1, 2. Palmprint Recognition Method Based on Multispectral Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3615-3625. |
[11] |
WANG Xiao-xuan1, LU Xiao-ping1*, LI Guo-qing2, WANG Jun2, YANG Zen-an1, ZHOU Yu-shi1, FENG Zhi-li1. Combining the Red Edge-Near Infrared Vegetation Indexes of DEM to
Extract Urban Vegetation Information[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2284-2289. |
[12] |
SUN Wen-bin2, WANG Rong1, 3, 4, GAO Rong-hua1, 3*, LI Qi-feng1, 3, WU Hua-rui1, 3, FENG Lu1, 3. Crop Disease Recognition Based on Visible Spectrum and Improved
Attention Module[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1572-1580. |
[13] |
LONG Ze-hao1, QIN Qi-ming1, 2, 3*, ZHANG Tian-yuan1, XU Wei1. Prediction of Continuous Time Series Leaf Area Index Based on Long Short-Term Memory Network: a Case Study of Winter Wheat[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(03): 898-904. |
[14] |
WANG Teng-jun1, 2, ZHAO Ming-hai3, YANG Yun1*, ZHANG Yang2, 4, CUI Qin-fang1, LI Long-tong1. Inversion of Heavy Metals Content in Soil Using Multispectral Remote Sensing Imagery in Daxigou Mining Area of Shaanxi[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(12): 3880-3887. |
[15] |
YANG Xue1,3,4, LI Xue-you2,3*, LI Jia-guo1*, MA Jun4, ZHANG Li2, YANG Jan1, DU Quan-ye2. Research on Fast Fourier Transforms Algorithm of Huge Remote Sensing Image Technology with GPU and Partitioning Technolog[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(02): 498-504. |
|
|
|
|