Smoothing Method for Sea Surface Rough Background Based on Multi-Spectral Forward-Looking Infrared Images Fusion
QIU Rong-chao1, LÜ Jun-wei1, GONG Jian1, LOU Shu-li2, XIU Bing-nan1, MA Xin-xing1
1. Naval Aviation University, Yantai 264001, China
2. School of Opto-Electronic Information Science and Technology, Yantai University, Yantai 264000, China
Abstract：For effectively overcoming the influence of rough background including point-clutter, strip wave and highlighted area in single-spectral forward-looking infrared (FLIR) image, a smoothing method for sea surface rough background based on multi-spectral FLIR images fusion is proposed. The method makes full use of the complementarity and difference existing in multi-spectral FLIR images. It aims at combining multiple images into a quality image in which the sea surface rough background is smoothed and the feature information of the ship targets is maintained good. Firstly, the multi-spectral source images were decomposed into low frequency sub-bands and high frequency sub-bands by discrete wavelet transform (DWT). The high frequency sub-band mainly contains the detailed information of the background and the ship target while the low frequency sub-band mainly contains the grayscale information. After obtaining the high frequency fusion image based on the maximum value of the high frequency coefficient, the regional energy of each pixel was calculated to modulate the high frequency fusion image in order to suppress the details of the background and maintain the details of the ship targets simultaneously. Then the low frequency fusion image was obtained by the average strategy and smoothed by the guided filter. Finally, the fusion image was reconstructed based on the high frequency fusion image and the low frequency fusion images by inverse wavelet transform. When the simulation experiment was carried out on the actually collected multi-spectral FLIR images to prove the effectiveness of the proposed method, the proposed method was compared with the other 6 smoothing methods including bilateral filter, guided filter, gradient minimization, relative total variation, bilateral texture filtering and rolling guidance filtering. A large number of experimental results show that the smoothing performance of the proposed method is better than the other 6 methods. The proposed method can effectively smooth the sea surface rough background and maintain the structure, grayscale, contrast of the ship targets, which can greatly enhance the separability of the ship targets. In the future work, the proposed method needs to be optimized to further improve the timeliness.
[1] Wang R, Du L. International Journal of Remote Sensing, 2014, 35(5): 1640.
[2] GAO Xue-qin, LIU Gang, XIAO Gang, et al（高雪琴, 刘 刚, 肖 刚, 等）. Acta Automatica Sinica（自动化学报）, 2019, doi: 10.16383/j.aas.2018.C180188.
[3] Ancuti C O, Ancuti C, De Vleeschouwer C, et al. IEEE Transactions on Image Processing, 2016, (1): 65.
[4] YE Ming, TANG Dun-bing（叶 明, 唐敦兵）. Journal of Electronic Measurement and Instrumentation（电子测量与仪器学报）, 2015, 29(9): 1328.
[5] ZHU Dan-dan, WANG Bin, YANG Yi, etal（朱丹丹, 王 斌, 杨 奕, 等）. Acta Metrologica Sinica（计量学报）, 2019, 40(1): 25.
[6] CHEN Zhen, YANG Xiao-ping, ZHANG Cong-xuan, et al（陈 震, 杨小平, 张聪炫, 等）. Chinese Journal of Scientific Instrument（仪器仪表学报）, 2016, 37(4): 860.
[7] LIU Zhan-wen, FENG Yan, WEI Bao-guo, et al（刘战文, 冯 燕, 卫保国, 等）. Journal of Optoelectronics·Laser（光电子·激光）, 2018, 29(4): 423.
[8] LIU Chun-xiao, SHAO Huan, CHEN Yan-jie, et al（刘春晓, 邵 欢, 陈艳杰, 等）. Journal of Computer-Aided Design & Computer Graphics（计算机辅助设计与图形学学报）, 2018, 30(5), 134.
[9] WANG Mi, HE Lu-xiao, CHENG Yu-feng, et al（王 密, 何鲁晓, 程宇峰, 等）. Acta Geodaetica et Cartographica Sinica（测绘学报）, 2018, 47(1): 82.
[10] LIU Feng, SHEN Tong-sheng, MA Xin-xing（刘 峰, 沈同圣, 马新星）. Chinese Journal of Scientific Instrument（仪器仪表学报）, 2017, 38(4): 1005.
[11] Qu J, Li Y, Dong W. Journal of Visual Communication & Image Representation, 2018, 52：151.
[12] PANG Xue-shun, WANG Huai-bin（庞学舜, 王怀彬）. Journal of Tianjin University of Technology（天津理工大学学报）, 2016, 32(1): 35.
[13] Xu L, Yan Q, Xia Y, et al. ACM Transactions on Graphics, 2012, 31(6): 1.
[14] Cho H, Lee H, Kang H, et al. ACM Transactions on Graphics, 2014, 33(4): 1.
[15] Zhang Q, Shen X Y, Xu L, et al. Rolling Guidance Filter European Conference on Computer Vision，2014. 815.
[16] He K, Sun J, Tang X. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2013, 35(6): 1397.
[17] WANG Yu-mei, CHEN Dai-mei, ZHAO Gen-bao（汪玉美, 陈代梅, 赵根保）. Laser & Optoelectronics Progress（激光与光电子学进展）, 2017, 54(1): 104.
