|
|
|
|
|
|
Infrared Mid-Wave and Long-Wave Image Fusion Based on FABEMD and Improved Local Energy Window |
CUI Xiao-rong, SHEN Tao*, HUANG Jian-lu, SUN Bin-bin |
Rocket Force University of Engineering, Xi’an 710025, China |
|
|
Abstract Aiming the scene contrast is low in the fusion process of the mid-wave infrared image with a detection band of 3.7 to 4.8 μm and the long-wave infrared image with a detection band of 8 to 14 μm, the saliency target is not enough to protrude, and the artifacts introduce serious problems. In this paper, Fast and Adaptive Bidimensional Empirical Mode Decomposition (FABEMD) is used to the multi-scale decomposition of infrared medium-wave and long-wave images to obtain two-dimensional intrinsic mode functions (BIMFs) and residual components (Residual). For each layer of bidimensional intrinsic mode function, this paper’s improved local energy window fusion rule is selected. First, a weighting operator is configured to increase the central pixel’s energy proportion for the regional window. In this paper, different weighting operators are selected, which have been verified to effectively highlight the energy characteristic information of medium-wave and long-wave images by experiments, and secondly, the phase information of BIMFs is fully used, when the phases are opposite, the energy weighted average method is used to solve the problem that the polarity sign of the fusion coefficient is difficult to determine. When the phases are the same, the energy gap is judged, and the set fusion rule is selected according to the size of the gap based on the grayscale difference characteristics of the infrared medium wave and long wave images. Using the infrared mid-wave image and improved the regional energy window of Saliency detection of maximum symmetric surround weight map guides the fusion of base layer coefficients for the residual components. The adaptive local surround window makes full use of the low-frequency saliency information and has a very good suppression effect on the useless background. It can highlight the saliency objects in the complex background image, and finally obtain the guidance image with rich details and obvious contrast. Finally, the fusion image is obtained through the inverse reconstruction process of FABEMD, and subjective and objective performance evaluations are performed on five sets of infrared medium and long-wave images with different backgrounds and different sizes. The four sets of images are all taken from multi-band infrared acquisition systems and are strictly registration and comparative experiments with 7 related algorithms. In terms of subjective performance, salient objects is standing out and the clarity is high, the objective performance is excellent in two evaluation indicators of average gradient and spatial frequency, the effectiveness of this algorithm is verified.
|
Received: 2020-06-29
Accepted: 2020-11-05
|
|
Corresponding Authors:
SHEN Tao
E-mail: luckyshentao@126.com
|
|
[1] Rogalski A. Proc. SPIE, 2017, 10433: 1.
[2] LIU Feng, SHEN Tong-sheng, GUO Shao-jun, et al(刘 峰, 沈同圣, 郭少军, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2017, 37(6): 1934.
[3] QIU Rong-chao, LOU Shu-li, LI Ting-jun, et al(仇荣超, 娄树理, 李廷军, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2019, 39(3): 698.
[4] Bhuiyans M A, Adhami R R, Khan J F. Eurasip Journal on Advances in Signal Processing, 2008, 2008(1): 1.
[5] LIN Zi-hui,WEI Yu-xing,ZHANG Jian-lin,et al(林子慧, 魏宇星, 张建林, 等). Infrared Technology(红外技术), 2019, 41(7): 640.
[6] Cheng M M, Mitra N J, Huang X, et al. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2015, 37(3): 569.
[7] FU Zhi-zhong, WANG Xue, LI Xiao-feng, et al(傅志中, 王 雪, 李晓峰, 等). Journal of University of Electronic Science and Technology of China(电子科技大学学报), 2017,46(2): 357.
[8] Achanta R, Susstrunk S. Saliency Detection Using Maximum Symmetric Surround. IEEE International Conference on Image Processing, 2010: 2653, doi: 10.1109/ICIP.2010.5652636.
[9] AN Ying, FAN Xun-li, CHEN Li, et al(安 影, 范训礼, 陈 莉, 等). Systems Engineering and Electronics(系统工程与电子技术), 2019(11): CN 11-2422/TN.
[10] PENG Zhi-yong, WANG Xiang-jun, LU Jin(彭志勇, 王向军, 卢 进). Infrared and Laser Engineering(红外与激光工程), 2014, 43(6): 1772.
[11] Yang Jinku, Guo Lei, Yang Haiku. IEEJ Transactions on Electrical and Electronic Engineering, IEEJ Trans,2015, 10: 447.
[12] Yin Ming, Liu Xiaoning, Liu Yu, et al. IEEE Transactions on Instrumentation and Measurement, 2018,(99):1.
[13] Cui G, Feng H, Xu Z, et al. Optics Communications, 2015, (341): 199. |
[1] |
LI Si-yuan, JIAO Jian-nan, WANG Chi*. Specular Reflection Removal Method Based on Polarization Spectrum
Fusion and Its Application in Vegetation Health Monitoring[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3607-3614. |
[2] |
ZHANG Tian-yao1, 2, LI Bo-yang1, LI Xing-yue1, LI Ying1, WU Xian-hao1, ZHAO Xiao-yan1, ZHANG Zhao-hui1*. Refractive Index Measurement Using Continuous Wave Terahertz
Frequency-Domain Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 495-502. |
[3] |
ZHU Wen-qing1, 2, 3, ZHANG Ning1, 2, 3, LI Zheng1, 2, 3*, LIU Peng1, 3, TANG Xin-yi1, 3. A Multi-Task Convolutional Neural Network for Infrared and Visible Multi-Resolution Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 289-296. |
[4] |
XU Xue-bin1, 2, XING Xiao-min1, 2*, AN Mei-juan1, 2, CAO Shu-xin1, 2, MENG Kan1, 2, LU Long-bin1, 2. Palmprint Recognition Method Based on Multispectral Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3615-3625. |
[5] |
SHEN Yu, YUAN Yu-bin*, PENG Jing. Research on Near Infrared and Color Visible Fusion Based on PCNN in Transform Domain[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2023-2027. |
[6] |
WANG Ning1, 2, WANG Chi1, BIAN Hai-yi2, WANG Jun3, WANG Peng2, BAI Peng-li3, YIN Huan-cai3, TIAN Yu-bing2, GAO Jing2*. The Identification Method of Blood by Applying Hilbert Transform to Extract Phase Information of Raman Spectra[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(08): 2412-2418. |
[7] |
ZHANG Jin1, WANG Jie1, SHEN Yan3, ZHANG Jin-bo4, CUI Hong-liang1,2*, SHI Chang-cheng2*. Wavelet-Based Image Fusion Method Applied in the Terahertz Nondestructive Evaluation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(12): 3683-3688. |
[8] |
LIU Feng1, SHEN Tong-sheng2, GUO Shao-jun1,ZHANG Jian3. Multi-Spectral Ship Target Recognition Based on Feature Level Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(06): 1934-1940. |
[9] |
LIU Jia-ni, JIN Wei-qi*, LI Li, WANG Xia . Visible and Infrared Thermal Image Fusion Algorithm Based on Self-Adaptive Reference Image [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(12): 3907-3914. |
[10] |
LIN Su-zhen, WANG Dong-juan, WANG Xiao-xia, ZHU Xiao-hong. Multi-Band Texture Image Fusion Based on the Embedded Multi-Scale Decomposition and Possibility Theory[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(07): 2337-2343. |
[11] |
LIN Su-zhen, YANG Feng-bao, CHEN Lei . Fusion of Dual Color MWIR Images Based on Support Value Transform and top-hat Decomposition [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(04): 1144-1150. |
[12] |
SHEN Yu1, DANG Jian-wu1, FENG Xin2, WANG Yang-ping1, HOU Yue1 . Infrared and Visible Images Fusion Based on Tetrolet Transform [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33(06): 1506-1511. |
[13] |
DOU Wen1, SUN Hong-quan2, CHEN Yun-hao2* . Comparison among Remotely Sensed Image Fusion Methods Based on Spectral Response Function[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31(03): 746-752. |
[14] |
ZHANG Guo-kun1,2,CHEN Chun1,XING Fu3,ZHANG Hong-yan1*,ZHAO Yun-sheng1 . Spectral Radiometric Calibration Research of Quick Bird Digital Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2008, 28(03): 494-498. |
|
|
|
|